00000001:02000400:1.0F:1788793280.626699:0:3118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788793302.161528:0:3339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788793304.304158:0:3400:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 683 MB/s 00000001:01000000:0.0:1788793304.558717:0:3400:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 515 MB/s 00000001:01000000:3.0F:1788793304.809178:0:3400:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4693 MB/s 00000020:02000000:3.0:1788793305.691511:0:3430:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gec2d9e5 00000400:02000000:3.0:1788793306.802488:0:3445:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.108@tcp [8/256/0/180] 00008000:02000000:2.0:1788793310.378908:0:3595:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788793362.907729:0:5200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 02000000:01000000:0.0:1788793819.119338:0:6003:0:(lproc_gss.c:195:rsi_upcall_store()) rsicache: rsi upcall set to /home/green/git/lustre-release/lustre/utils/gss/l_getauth 00000020:01000004:2.0:1788793830.543288:0:6505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788793830.543294:0:6505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788793830.543295:0:6505:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788793830.557089:0:6505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a4c93fdb 00000080:02000400:3.0:1788793830.557110:0:6505:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788793830.569936:0:6505:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788793830.569950:0:6505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788793830.569983:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000acbe4f0) 00000020:00000080:3.0:1788793830.570000:0:6505:0:(obd_config.c:716:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788793830.681680:0:6505:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788793830.681757:0:6505:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788793830.704970:0:6505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788793830.706520:0:6505:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788793830.706532:0:6505:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788793830.706548:0:6505:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a73e 00000020:01000004:2.0:1788793830.706556:0:6505:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788793830.706561:0:6505:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788793830.706566:0:6505:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a4c93fdb from MGS 00000020:01000004:2.0:1788793830.706571:0:6505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788793830.706593:0:6505:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f65f6e6d) 00000020:00000080:2.0:1788793830.706604:0:6505:0:(obd_config.c:716:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788793830.706660:0:6505:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a4c93fdb from MGS, refs=2 00080000:01000000:2.0:1788793830.706666:0:6505:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788793830.706673:0:6505:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a74c 00000100:00100000:2.0:1788793830.706782:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788793830.706934:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788793830.706940:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788793830.715437:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788793830.715450:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788793830.722719:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793830.722931:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788793830.722938:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788793830.723923:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788793830.723931:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788793830.725951:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788793830.725964:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788793830.728270:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793830.728284:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793830.728286:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793830.728876:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793830.728879:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793830.728880:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793830.729930:0:6505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788793830.735505:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788793830.979193:0:6505:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2127 MB/s 00000001:01000000:1.0:1788793831.229299:0:6505:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3695 MB/s 00000001:01000000:2.0:1788793831.479466:0:6505:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 583 MB/s 00000001:01000000:0.0:1788793831.730179:0:6505:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 800 MB/s 00080000:10000000:2.0:1788793831.738460:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788793831.752943:0:6505:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788793831.758881:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788793831.761791:0:6505:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788793831.761859:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788793831.762079:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788793831.762112:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788793831.762487:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793831.765444:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788793831.765472:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788793831.765942:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788793831.765947:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788793831.770114:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788793831.770154:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788793831.770911:0:6505:0:(obd_config.c:813:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788793831.770931:0:6505:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.108@tcp' 00000020:01000004:0.0:1788793831.770932:0:6505:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788793831.771055:0:6505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.108@tcp (typ=mgc) 00000020:00000080:0.0:1788793831.771074:0:6505:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.108@tcp (00000000d8ab4e88) 00000020:00000080:0.0:1788793831.771091:0:6505:0:(obd_config.c:716:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788793831.771230:0:6505:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000076d397cd@MGC192.168.201.108@tcp: add connection 192.168.201.108@tcp at head 00000100:00080000:2.0:1788793831.771731:0:6525:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1788793831.772889:0:6505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.108@tcp-0 is initialized 00000040:01000000:0.0:1788793831.772897:0:6505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 1 is initialized 00010000:00010000:1.0:1788793831.772999:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788793831.783847:0:6526:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788793831.785924:0:6505:0:(obd_config.c:813:class_setup()) finished setup of obd MGC192.168.201.108@tcp (uuid d90946e9-48a2-4a27-88e6-1a1d8eafc0f2) 00000020:00000080:2.0:1788793831.785951:0:6505:0:(genops.c:1375:class_connect()) connect: client d90946e9-48a2-4a27-88e6-1a1d8eafc0f2, cookie 0x962a5e377b33a75a 00000100:00080000:2.0:1788793831.785963:0:6505:0:(import.c:545:import_select_connection()) MGC192.168.201.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793831.785975:0:6505:0:(import.c:666:import_select_connection()) MGC192.168.201.108@tcp: import 0000000076d397cd using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1788793831.786020:0:6505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cce4b241 x1875685729632384/t0(0) o250->MGC192.168.201.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788793831.786041:0:6505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d90946e9-48a2-4a27-88e6-1a1d8eafc0f2->MGS 00000020:01000004:2.0:1788793831.786068:0:6505:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788793831.786073:0:6505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788793831.786085:0:6505:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000060343d03) 00000020:00000080:2.0:1788793831.786097:0:6505:0:(obd_config.c:716:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788793831.786464:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cce4b241 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3460:1875685729632384:0@lo:250: 00000100:00100000:1.0:1788793831.786551:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793831.788909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729632384 00000100:00100000:1.0:1788793831.788920:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729632384 00000100:00100000:1.0:1788793831.788979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788793831.788986:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f06d929 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3460:x1875685729632384:12345-0@lo:250: 00010000:00080000:1.0:1788793831.789014:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d90946e9-48a2-4a27-88e6-1a1d8eafc0f2@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:1.0:1788793831.789043:0:6522:0:(genops.c:1375:class_connect()) connect: client d90946e9-48a2-4a27-88e6-1a1d8eafc0f2, cookie 0x962a5e377b33a768 00000100:00080000:1.0:1788793831.789213:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000ba3befdd : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788793831.789364:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f06d929 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:3460:x1875685729632384:12345-0@lo:250: Request processed in 376us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793831.789371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788793831.789410:0:3460:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788793831.789420:0:3460:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.108@tcp: connect to target with instance 0 00000100:00080000:1.0:1788793831.789428:0:3460:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788793831.789432:0:3460:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788793831.789435:0:3460:0:(import.c:65:import_set_state_nolock()) 0000000076d397cd MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788793831.789437:0:3460:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788793831.789446:0:3460:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788793831.789450:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cce4b241 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3460:1875685729632384:0@lo:250: 00000100:00100000:0.0:1788793831.811504:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793831.811709:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788793831.811716:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788793831.816765:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788793831.816779:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788793831.817609:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788793831.817623:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788793831.818729:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793831.818934:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788793831.818941:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788793831.819672:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788793831.819679:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788793831.874524:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793831.874911:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788793831.874918:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788793831.884905:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788793831.884923:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788793831.885824:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788793831.886036:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788793831.886043:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788793831.888462:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788793831.888474:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788793831.889381:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788793831.889578:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788793831.889584:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788793831.890367:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788793831.890376:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788793831.890889:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793831.891049:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788793831.891053:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788793831.891955:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788793831.891962:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788793831.928721:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793831.928944:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788793831.928950:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788793831.931498:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788793831.931510:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788793831.932637:0:6505:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788793831.932646:0:6505:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788793831.933733:0:6505:0:(obd_config.c:813:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788793831.933759:0:6505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788793831.933765:0:6505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788793831.933945:0:6505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788793831.933979:0:6505:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788793831.933993:0:6505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788793831.933995:0:6505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788793831.933996:0:6505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793831.933997:0:6505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793831.934003:0:6505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793831.934004:0:6505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793831.934005:0:6505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788793831.934006:0:6505:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788793831.934007:0:6505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793831.934008:0:6505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793831.934010:0:6505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793831.934011:0:6505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788793831.934013:0:6505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788793831.934015:0:6505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788793831.934016:0:6505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788793831.934017:0:6505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793831.934017:0:6505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793831.934018:0:6505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793831.934019:0:6505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793831.934020:0:6505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788793831.934020:0:6505:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788793831.934021:0:6505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793831.934022:0:6505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793831.934022:0:6505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793831.934023:0:6505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788793831.934059:0:6505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788793831.934076:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d7b4907 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632512:0@lo:253: 00000100:00100000:3.0:1788793831.934199:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793831.934240:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073b2c6c4 going to sleep for 11 seconds 00000100:00100000:0.0:1788793831.934422:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729632512 00000100:00100000:0.0:1788793831.934430:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729632512 00000100:00100000:0.0:1788793831.934472:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793831.934480:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004936e4a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:6505:x1875685729632512:12345-0@lo:253: 20000000:01000000:0.0:1788793831.934522:0:6524:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788793831.934525:0:6524:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788793831.936924:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788793831.936996:0:6524:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788793831.937674:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788793831.939424:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788793831.939723:0:6524:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788793831.939728:0:6524:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788793831.939733:0:6524:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788793831.939737:0:6524:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788793831.939750:0:6524:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788793831.939949:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788793831.940533:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788793831.940549:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788793831.940568:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788793831.940586:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788793831.940600:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788793831.940658:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788793831.940667:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788793831.940679:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788793831.940684:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788793831.940698:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788793831.940704:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788793831.940716:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788793831.940732:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788793831.940760:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788793831.940765:0:6524:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788793831.940771:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788793831.940857:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788793831.940879:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788793831.940895:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788793831.940908:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788793831.940920:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788793831.940929:0:6524:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788793831.940952:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788793831.940960:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788793831.941345:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788793831.941371:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788793831.941388:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788793831.941399:0:6524:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788793831.941425:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788793831.941432:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788793831.941444:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788793831.941458:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788793831.941512:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788793831.941531:0:6524:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788793831.941538:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788793831.941880:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788793831.942221:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788793831.942245:0:6524:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.108@tcp for mdt 20000000:01000000:1.0:1788793831.942247:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:1.0:1788793831.942338:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788793831.942346:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788793831.942359:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788793831.942365:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:1.0:1788793831.942378:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788793831.942386:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788793831.942397:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788793831.942413:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788793831.942442:0:6524:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788793831.942446:0:6524:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788793831.942449:0:6524:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788793831.942505:0:6524:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788793831.942508:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788793831.942848:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788793831.943066:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788793831.943100:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788793831.943117:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788793831.943188:0:6524:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788793831.943196:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788793831.946093:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788793831.949484:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788793831.949521:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788793831.949538:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788793831.949551:0:6524:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788793831.949553:0:6524:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788793831.949558:0:6524:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788793831.949561:0:6524:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788793831.949566:0:6524:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788793831.949573:0:6524:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788793831.950073:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788793831.950634:0:6524:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788793831.963235:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788793831.963288:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788793831.963316:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788793831.963338:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788793831.963359:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963375:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963385:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963391:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963397:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963415:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963421:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c69ac58a already unused, calling callback (00000000b72af411) 00010000:00010000:0.0:1788793831.963424:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963431:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963443:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963449:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.963455:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a76f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788793831.963472:0:6524:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788793831.977059:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004936e4a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:6505:x1875685729632512:12345-0@lo:253: Request processed in 42573us (42854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793831.977073:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793831.977185:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d7b4907 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632512:0@lo:253: 10000000:01000000:2.0:1788793831.977201:0:6505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788793831.977205:0:6505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788793831.977206:0:6505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788793831.977207:0:6505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793831.977208:0:6505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788793831.977210:0:6505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793831.977211:0:6505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793831.977212:0:6505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788793831.977213:0:6505:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788793831.977226:0:6505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788793831.977227:0:6505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793831.977229:0:6505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788793831.977245:0:6505:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a4c93fdb from lustre-MDT0000 10000000:01000000:2.0:1788793831.977285:0:6505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788793831.977287:0:6505:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788793831.977292:0:6505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9af4ce6799e8 10000000:01000000:2.0:1788793831.977296:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793831.977303:0:6505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af4ce6799e8 from 1 10000000:01000000:2.0:1788793831.977306:0:6505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788793831.977342:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.977352:0:6505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.977361:0:6505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793831.977376:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632640:0@lo:101: 00000100:00100000:2.0:1788793831.977406:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793831.977445:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020080f2c going to sleep for 11 seconds 00000100:00100000:0.0:1788793831.977540:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729632640 00000100:00100000:0.0:1788793831.977546:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729632640 00000100:00100000:0.0:1788793831.977572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788793831.977578:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005dd499ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:6505:x1875685729632640:12345-0@lo:101: 00010000:00010000:0.0:1788793831.977589:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793831.977599:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a469767/0x962a5e377b33a77d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a776 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.977625:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a469767/0x962a5e377b33a77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a776 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.977634:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a469767/0x962a5e377b33a77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a776 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.977641:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a469767, rc 0) 00000100:00100000:0.0:1788793831.977674:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005dd499ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+6:6505:x1875685729632640:12345-0@lo:101: Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793831.977679:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788793831.977766:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632640:0@lo:101: 00010000:00010000:2.0:1788793831.977777:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.977785:0:6505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793831.977840:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632768:0@lo:501: 00000100:00100000:2.0:1788793831.977861:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793831.977899:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020080f2c going to sleep for 11 seconds 00000100:00100000:0.0:1788793831.978001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729632768 00000100:00100000:0.0:1788793831.978005:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729632768 00000100:00100000:0.0:1788793831.978031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788793831.978036:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b99c0c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+6:6505:x1875685729632768:12345-0@lo:501: 00000100:00100000:0.0:1788793831.978098:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b99c0c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+6:6505:x1875685729632768:12345-0@lo:501: Request processed in 61us (236us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788793831.978104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793831.978222:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632768:0@lo:501: 10000000:01000000:2.0:1788793831.978245:0:6505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788793831.978260:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978267:0:6505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 0000000074a19cdf/0x962a5e377b33a776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793831.978275:0:6505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af4dfc78000 10000000:01000000:2.0:1788793831.978278:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788793831.978281:0:6505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9af4dfc78000 10000000:01000000:2.0:1788793831.978284:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788793831.978286:0:6505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9af4dfc78000 from 1 10000000:01000000:2.0:1788793831.978288:0:6505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788793831.978300:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978306:0:6505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978312:0:6505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793831.978321:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632896:0@lo:101: 00000100:00100000:2.0:1788793831.978341:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793831.978364:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020080f2c going to sleep for 11 seconds 00000100:00100000:0.0:1788793831.978474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729632896 00000100:00100000:0.0:1788793831.978478:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729632896 00000100:00100000:0.0:1788793831.978504:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788793831.978508:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fdd53a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+6:6505:x1875685729632896:12345-0@lo:101: 00010000:00010000:0.0:1788793831.978515:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793831.978522:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099006792/0x962a5e377b33a78b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a784 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.978534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099006792/0x962a5e377b33a78b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a784 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.978551:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099006792/0x962a5e377b33a78b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a784 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.978559:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099006792, rc 0) 00000100:00100000:0.0:1788793831.978588:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fdd53a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+7:6505:x1875685729632896:12345-0@lo:101: Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793831.978593:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788793831.978667:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729632896:0@lo:101: 00010000:00010000:2.0:1788793831.978676:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a78b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978687:0:6505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a78b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793831.978696:0:6505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788793831.978709:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a78b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978715:0:6505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000c9c2ece3/0x962a5e377b33a784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a78b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793831.978721:0:6505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788793831.978723:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793831.978726:0:6505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9af4dfc78000 10000000:01000000:2.0:1788793831.978728:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788793831.978731:0:6505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788793831.978733:0:6505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788793831.978743:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978749:0:6505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.978755:0:6505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793831.978764:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633024:0@lo:101: 00000100:00100000:2.0:1788793831.978784:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793831.978801:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020080f2c going to sleep for 11 seconds 00000100:00100000:0.0:1788793831.978930:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633024 00000100:00100000:0.0:1788793831.978934:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633024 00000100:00100000:0.0:1788793831.978958:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793831.978963:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f54de4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+7:6505:x1875685729633024:12345-0@lo:101: 00010000:00010000:0.0:1788793831.978969:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793831.978975:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6c5eb9f/0x962a5e377b33a799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a792 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.978986:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6c5eb9f/0x962a5e377b33a799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a792 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.978992:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6c5eb9f/0x962a5e377b33a799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a792 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793831.978998:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6c5eb9f, rc 0) 00000100:00100000:0.0:1788793831.979026:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f54de4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+8:6505:x1875685729633024:12345-0@lo:101: Request processed in 64us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793831.979031:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788793831.979109:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633024:0@lo:101: 00010000:00010000:2.0:1788793831.979118:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793831.979146:0:6505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793831.979179:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633152:0@lo:501: 00000100:00100000:2.0:1788793831.979200:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793831.979217:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020080f2c going to sleep for 11 seconds 00000100:00100000:1.0:1788793831.979264:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633152 00000100:00100000:1.0:1788793831.979268:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633152 00000100:00100000:1.0:1788793831.979289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793831.979293:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ff46945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+8:6505:x1875685729633152:12345-0@lo:501: 00000100:00100000:1.0:1788793831.979376:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ff46945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6505:x1875685729633152:12345-0@lo:501: Request processed in 83us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793831.979382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788793831.979536:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633152:0@lo:501: 00000100:00100000:2.0:1788793831.979557:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633280:0@lo:503: 00000100:00100000:2.0:1788793831.979588:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793831.979611:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020080f2c going to sleep for 11 seconds 00000100:00100000:1.0:1788793831.979649:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633280 00000100:00100000:1.0:1788793831.979653:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633280 00000100:00100000:1.0:1788793831.979676:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788793831.979680:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063d639df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6505:x1875685729633280:12345-0@lo:503: 00000100:00100000:1.0:1788793831.979744:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063d639df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6505:x1875685729633280:12345-0@lo:503: Request processed in 64us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793831.979751:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788793831.979833:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633280:0@lo:503: 00000100:00100000:1.0:1788793831.980321:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049586a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6551:1875685729633408:0@lo:502: 00000100:00100000:1.0:1788793831.980356:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793831.980391:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 00000000681ebe06 going to sleep for 11 seconds 00000100:00100000:0.0:1788793831.980486:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633408 00000100:00100000:0.0:1788793831.980490:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633408 00000100:00100000:0.0:1788793831.980522:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793831.980535:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000317bcd4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6551:x1875685729633408:12345-0@lo:502: 00000100:00100000:0.0:1788793831.980619:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000317bcd4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6551:x1875685729633408:12345-0@lo:502: Request processed in 86us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793831.980626:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788793831.980728:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049586a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6551:1875685729633408:0@lo:502: 00000020:01000000:2.0:1788793831.980749:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793831.980759:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793831.980761:0:6551:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788793831.980765:0:6551:0:(obd_config.c:1951:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788793831.980768:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793831.980781:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000098b0a270) 00000020:00000080:2.0:1788793831.980798:0:6551:0:(obd_config.c:716:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788793831.980803:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788793831.981240:0:6551:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788793831.981248:0:6551:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a7a7 00000020:00000080:2.0:1788793831.981560:0:6551:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788793831.981566:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793831.981574:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793831.981576:0:6551:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788793831.981579:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793831.981583:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793831.981584:0:6551:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788793831.981588:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793831.981596:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001a62705d) 00000020:00000080:2.0:1788793831.981608:0:6551:0:(obd_config.c:716:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788793831.981612:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788793831.981614:0:6551:0:(obd_config.c:1500:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788793831.981616:0:6551:0:(obd_config.c:1133:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788793831.981621:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788793831.981671:0:6551:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a4c93fdb from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788793831.981691:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004120ec4b) 00000020:00000080:2.0:1788793831.981700:0:6551:0:(obd_config.c:716:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788793831.981763:0:6551:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788793831.981769:0:6551:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x962a5e377b33a7bc 00000020:00000080:2.0:1788793831.982036:0:6551:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788793831.982043:0:6551:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788793831.982047:0:6551:0:(genops.c:1375:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x962a5e377b33a7c3 00080000:01000000:2.0:1788793831.982052:0:6551:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788793831.982056:0:6551:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a7ca 00080000:10000000:2.0:1788793831.982537:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788793831.982695:0:6551:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788793831.988617:0:6551:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788793832.084564:0:6551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788793832.084976:0:6551:0:(tgt_lastrcvd.c:1869:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788793832.097542:0:6551:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788793832.097852:0:6551:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788793832.106855:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000095558e78) 00000020:00000080:2.0:1788793832.106892:0:6551:0:(obd_config.c:716:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788793832.106962:0:6551:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788793832.106968:0:6551:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a7d8 00000020:00000080:2.0:1788793832.115046:0:6551:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788793832.115855:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788793832.122831:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788793832.129610:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788793832.133758:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788793832.137809:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788793832.140477:0:6551:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788793832.147570:0:6551:0:(genops.c:1375:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x962a5e377b33a7df 00000020:00000080:2.0:1788793832.148226:0:6551:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788793832.148238:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793832.148243:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793832.148246:0:6551:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788793832.148311:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793832.148317:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793832.148318:0:6551:0:(obd_config.c:1547:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788793832.148321:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793832.148323:0:6551:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788793832.148326:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793832.148328:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793832.148329:0:6551:0:(obd_config.c:1547:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788793832.148331:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793832.148334:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793832.148335:0:6551:0:(obd_config.c:1547:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788793832.148339:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788793832.148382:0:6551:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788793832.148441:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6551:1875685729633536:0@lo:502: 00000100:00100000:2.0:1788793832.148517:0:6551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793832.148580:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set 00000000839daed2 going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.148768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633536 00000100:00100000:0.0:1788793832.148775:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633536 00000100:00100000:0.0:1788793832.148873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788793832.148883:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd8b6263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6551:x1875685729633536:12345-0@lo:502: 00000100:00100000:0.0:1788793832.149011:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd8b6263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6551:x1875685729633536:12345-0@lo:502: Request processed in 129us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793832.149019:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788793832.149095:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6551:1875685729633536:0@lo:502: 00000020:01000000:2.0:1788793832.149154:0:6551:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793832.149159:0:6551:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793832.149161:0:6551:0:(obd_config.c:1547:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788793832.149164:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788793832.150859:0:6505:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788793832.150896:0:6505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788793832.150919:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.150931:0:6505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000a252b57a/0x962a5e377b33a792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793832.150940:0:6505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af4dfc78000 from 1 10000000:01000000:3.0:1788793832.150943:0:6505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788793832.150993:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.151002:0:6505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.151011:0:6505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793832.151029:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633664:0@lo:101: 00000100:00100000:3.0:1788793832.151079:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793832.151540:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a19759b going to sleep for 11 seconds 00000100:00100000:1.0:1788793832.152450:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633664 00000100:00100000:1.0:1788793832.152459:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633664 00000100:00100000:1.0:1788793832.152497:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788793832.152504:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067fc2c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:6505:x1875685729633664:12345-0@lo:101: 00010000:00010000:1.0:1788793832.152517:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793832.152532:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a7e6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.152554:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.152564:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.152571:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022fc63c8, rc 0) 00000100:00100000:1.0:1788793832.152626:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067fc2c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:6505:x1875685729633664:12345-0@lo:101: Request processed in 122us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793832.152633:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793832.152729:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633664:0@lo:101: 00010000:00010000:3.0:1788793832.152746:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.152754:0:6505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793832.153516:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633792:0@lo:256: 00000100:00100000:3.0:1788793832.156615:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793832.156701:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a19759b going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.156789:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633792 00000100:00100000:0.0:1788793832.156799:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633792 00000100:00100000:2.0:1788793832.156909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788793832.156919:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000013c1d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:6505:x1875685729633792:12345-0@lo:256: 20000000:01000000:2.0:1788793832.156955:0:6522:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788793832.156960:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788793832.157050:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000013c1d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:6505:x1875685729633792:12345-0@lo:256: Request processed in 133us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793832.157058:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788793832.157216:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633792:0@lo:256: 10000000:01000000:3.0:1788793832.157791:0:6505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788793832.157809:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.157820:0:6505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793832.157828:0:6505:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af4dfc78000 from 1 10000000:01000000:3.0:1788793832.157832:0:6505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788793832.157872:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.157879:0:6505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.157887:0:6505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793832.157905:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633920:0@lo:101: 00000100:00100000:3.0:1788793832.157940:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793832.160543:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a19759b going to sleep for 11 seconds 00000100:00100000:1.0:1788793832.160628:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729633920 00000100:00100000:1.0:1788793832.160638:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729633920 00000100:00100000:1.0:1788793832.160695:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788793832.160703:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7bce629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:6505:x1875685729633920:12345-0@lo:101: 00010000:00010000:1.0:1788793832.160718:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793832.160734:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a7f4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.160760:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.160789:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.160797:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2319115, rc 0) 00000100:00100000:1.0:1788793832.161238:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7bce629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6505:x1875685729633920:12345-0@lo:101: Request processed in 535us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793832.161245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788793832.161456:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729633920:0@lo:101: 00010000:00010000:3.0:1788793832.161474:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.161482:0:6505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793832.161559:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634048:0@lo:501: 00000100:00100000:3.0:1788793832.161591:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793832.161622:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a19759b going to sleep for 11 seconds 00000100:00100000:1.0:1788793832.161674:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634048 00000100:00100000:1.0:1788793832.161687:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634048 00000100:00100000:1.0:1788793832.161716:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788793832.161722:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004410237b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6505:x1875685729634048:12345-0@lo:501: 00000100:00100000:1.0:1788793832.162004:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004410237b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6505:x1875685729634048:12345-0@lo:501: Request processed in 283us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793832.162011:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788793832.162537:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634048:0@lo:501: 00000100:00100000:3.0:1788793832.162569:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634176:0@lo:503: 00000100:00100000:3.0:1788793832.162613:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793832.162732:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a19759b going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.162767:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634176 00000100:00100000:0.0:1788793832.162772:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634176 00000100:00100000:0.0:1788793832.162831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788793832.162839:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c0d735b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6505:x1875685729634176:12345-0@lo:503: 00000040:00080000:0.0:1788793832.162892:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788793832.162941:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c0d735b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6505:x1875685729634176:12345-0@lo:503: Request processed in 102us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793832.162947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788793832.163027:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634176:0@lo:503: 00000040:00080000:3.0:1788793832.166817:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788793832.167118:0:6505:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788793832.167161:0:6505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788793832.167178:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.167190:0:6505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793832.167242:0:6505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788793832.167245:0:6505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af4dfc78000 10000000:01000000:2.0:1788793832.167258:0:6505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af4dfc78000 10000000:01000000:2.0:1788793832.167263:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793832.167268:0:6505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4dfc78000 from 1 10000000:01000000:2.0:1788793832.167271:0:6505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793832.167304:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.167312:0:6505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.167322:0:6505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793832.167341:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634304:0@lo:101: 00000100:00100000:2.0:1788793832.167404:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793832.167838:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000678871eb going to sleep for 11 seconds 00000100:00100000:1.0:1788793832.167907:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634304 00000100:00100000:1.0:1788793832.167914:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634304 00000100:00100000:1.0:1788793832.167950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788793832.167958:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b708d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6505:x1875685729634304:12345-0@lo:101: 00010000:00010000:1.0:1788793832.167969:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793832.167980:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056486dcd/0x962a5e377b33a809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a802 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.168013:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056486dcd/0x962a5e377b33a809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a802 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.168022:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056486dcd/0x962a5e377b33a809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a802 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793832.168041:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056486dcd, rc 0) 00000100:00100000:1.0:1788793832.168088:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b708d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729634304:12345-0@lo:101: Request processed in 131us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793832.168095:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788793832.169789:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634304:0@lo:101: 00010000:00010000:2.0:1788793832.169814:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.169825:0:6505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793832.169911:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634432:0@lo:501: 00000100:00100000:2.0:1788793832.169959:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793832.170006:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000678871eb going to sleep for 11 seconds 00000100:00100000:1.0:1788793832.170164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634432 00000100:00100000:1.0:1788793832.170170:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634432 00000100:00100000:1.0:1788793832.170200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788793832.170206:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000003f2235c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729634432:12345-0@lo:501: 00000100:00100000:1.0:1788793832.170396:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000003f2235c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729634432:12345-0@lo:501: Request processed in 190us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793832.170404:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788793832.170571:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634432:0@lo:501: 00000100:00100000:2.0:1788793832.170599:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634560:0@lo:503: 00000100:00100000:2.0:1788793832.170641:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793832.170670:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000678871eb going to sleep for 11 seconds 00000100:00100000:1.0:1788793832.170708:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634560 00000100:00100000:1.0:1788793832.170713:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634560 00000100:00100000:1.0:1788793832.170745:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788793832.170751:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ec9172e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729634560:12345-0@lo:503: 00000100:00100000:1.0:1788793832.170823:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ec9172e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729634560:12345-0@lo:503: Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793832.170829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788793832.170958:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729634560:0@lo:503: 00000100:00100000:1.0:1788793832.171575:0:6556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a714814 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6556:1875685729634688:0@lo:502: 00000100:00100000:1.0:1788793832.171613:0:6556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793832.171634:0:6556:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1229339 going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.172848:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634688 00000100:00100000:0.0:1788793832.172858:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634688 00000100:00100000:0.0:1788793832.172957:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788793832.172966:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d0a0957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6556:x1875685729634688:12345-0@lo:502: 00000100:00100000:0.0:1788793832.173120:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d0a0957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6556:x1875685729634688:12345-0@lo:502: Request processed in 155us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793832.173148:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788793832.173296:0:6556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a714814 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6556:1875685729634688:0@lo:502: 00000020:01000004:1.0:1788793832.173360:0:6556:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788793832.173385:0:6556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000377dc7fa) 00000020:00000080:1.0:1788793832.173404:0:6556:0:(obd_config.c:716:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788793832.173491:0:6556:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a4c93fdb from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788793832.173495:0:6556:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a4c93fdb from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788793832.173497:0:6556:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a4c93fdb 4 00010000:00080000:1.0:1788793832.173532:0:6556:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009b9b410d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:1.0:1788793832.175112:0:6556:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788793832.175351:0:6556:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788793832.175389:0:6556:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788793832.175409:0:6556:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x962a5e377b33a817 00000100:00080000:1.0:1788793832.175418:0:6556:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788793832.175427:0:6556:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009b9b410d using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1788793832.175461:0:6556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a714814 x1875685729634816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788793832.175500:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a714814 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1875685729634816:0@lo:38: 00000100:00100000:1.0:1788793832.175557:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788793832.175614:0:6556:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788793832.177487:0:6556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc10014c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6556:1875685729634944:0@lo:502: 00000100:00100000:1.0:1788793832.177562:0:6556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793832.177695:0:6556:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012595892 going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.177838:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634944 00000100:00100000:0.0:1788793832.177846:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634944 00000100:00100000:0.0:1788793832.177889:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788793832.177896:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a9bf00b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6556:x1875685729634944:12345-0@lo:502: 00000100:00100000:0.0:1788793832.178192:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a9bf00b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6556:x1875685729634944:12345-0@lo:502: Request processed in 296us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793832.178200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788793832.178376:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729634816 00000100:00100000:3.0:1788793832.178381:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729634816 00000100:00100000:3.0:1788793832.178404:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793832.178409:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fac11f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1875685729634816:12345-0@lo:38: 00000100:00100000:3.0:1788793832.178458:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fac11f8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1875685729634816:12345-0@lo:38: Request processed in 48us (2901us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788793832.178464:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793832.181201:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788793832.181213:0:3460:0:(import.c:65:import_set_state_nolock()) 000000009b9b410d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788793832.181220:0:3460:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788793832.181224:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a714814 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1875685729634816:0@lo:38: 00000100:00100000:1.0:1788793832.181405:0:6556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc10014c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6556:1875685729634944:0@lo:502: 00000040:00080000:1.0:1788793832.181440:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788793832.181586:0:6505:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788793832.181609:0:6505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788793832.181630:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793832.181641:0:6505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000000ea36391/0x962a5e377b33a802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788793832.181688:0:6505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788793832.181691:0:6505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788793832.181692:0:6505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793832.181693:0:6505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793832.181694:0:6505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793832.181695:0:6505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793832.181697:0:6505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788793832.181698:0:6505:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788793832.181699:0:6505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793832.181701:0:6505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793832.181702:0:6505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793832.181703:0:6505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788793832.181707:0:6505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788793832.181714:0:6505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788793832.181715:0:6505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788793832.181716:0:6505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793832.181717:0:6505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793832.181717:0:6505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793832.181718:0:6505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793832.181719:0:6505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788793832.181720:0:6505:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788793832.181720:0:6505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793832.181721:0:6505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793832.181722:0:6505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793832.181723:0:6505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788793832.181753:0:6505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788793832.181765:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023f5b7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729635072:0@lo:253: 00000100:00100000:0.0:1788793832.181823:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793832.181853:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000008edaec8e going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.181885:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635072 00000100:00100000:0.0:1788793832.181891:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635072 00000100:00100000:0.0:1788793832.181928:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788793832.181936:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000002cdb1e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729635072:12345-0@lo:253: 20000000:01000000:0.0:1788793832.181958:0:6523:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788793832.181970:0:6523:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788793832.191468:0:6523:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788793832.191487:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788793832.191734:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000002cdb1e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6505:x1875685729635072:12345-0@lo:253: Request processed in 9794us (9906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793832.191747:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:0.0:1788793832.191812:0:6545:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788793832.191817:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788793832.191833:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793832.191846:0:6545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793832.191853:0:6545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793832.191895:0:6545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793832.191922:0:6545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 11 pid: 6523 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793832.191936:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c77603e3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6545:1875685729635200:0@lo:104: 00000100:00100000:0.0:1788793832.191971:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793832.194523:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fabc5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788793832.194581:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023f5b7de pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6505:1875685729635072:0@lo:253: 10000000:01000000:0.0:1788793832.194595:0:6505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788793832.194598:0:6505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788793832.194600:0:6505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788793832.194601:0:6505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793832.194602:0:6505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793832.194604:0:6505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793832.194605:0:6505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793832.194606:0:6505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788793832.194607:0:6505:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788793832.194608:0:6505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793832.194610:0:6505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793832.194611:0:6505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793832.194612:0:6505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788793832.194627:0:6505:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788793832.195340:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635200 00000100:00100000:3.0:1788793832.195350:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635200 00000100:00100000:3.0:1788793832.195409:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793832.195417:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035af9519 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6545:x1875685729635200:12345-0@lo:104: 00010000:00010000:3.0:1788793832.195448:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.195533:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793832.195538:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035af9519 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6545:x1875685729635200:12345-0@lo:104: Request processed in 123us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793832.195545:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788793832.195572:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793832.195577:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.195585:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b5306551 already unused, calling callback (00000000f6960efc) 10000000:00010000:3.0:1788793832.195588:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.195597:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793832.195603:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793832.195607:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793832.195646:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.195653:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793832.195669:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.195674:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 00000000b5306551/0x962a5e377b33a7e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a7ed expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.195697:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793832.195699:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793832.195700:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793832.195796:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729635328:0@lo:103: 00000100:00100000:3.0:1788793832.195832:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793832.196189:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c77603e3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6545:1875685729635200:0@lo:104: 00010000:00010000:1.0:1788793832.196207:0:6545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793832.196381:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635328 00000100:00100000:2.0:1788793832.196386:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635328 00010000:00010000:2.0:1788793832.196405:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 12 pid: 6523 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793832.196436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788793832.196443:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e445b61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3462:x1875685729635328:12345-0@lo:103: 00010000:00010000:2.0:1788793832.196454:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793832.196458:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 12 pid: 6523 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196480:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 12 pid: 6523 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196494:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022fc63c8/0x962a5e377b33a7ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a7e6 expref: 12 pid: 6523 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196508:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196515:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788793832.196529:0:6513:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004712060s 00010000:00010000:2.0:1788793832.196533:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196539:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196545:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196550:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196555:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c69ac58a already unused, calling callback (00000000b72af411) 00010000:00010000:2.0:1788793832.196558:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196563:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196585:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793832.196594:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793832.196627:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e445b61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3462:x1875685729635328:12345-0@lo:103: Request processed in 185us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793832.196633:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793832.197211:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024cae2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729635328:0@lo:103: 00010000:00010000:3.0:1788793832.197233:0:6545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.197240:0:6545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793832.197246:0:6545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c69ac58a/0x962a5e377b33a81e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788793832.205811:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788793832.205965:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788793832.206453:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788793832.206611:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788793832.206795:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788793832.206966:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788793832.208430:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788793832.208606:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788793832.208810:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788793832.208995:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788793832.209244:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788793832.209425:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788793832.215776:0:6505:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788793832.233595:0:6505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788793832.233963:0:6562:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788793832.235529:0:6561:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788793832.235536:0:6561:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788793832.238402:0:6505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788793832.238510:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788793832.239451:0:6505:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788793832.239462:0:6505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788793832.239605:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793832.245561:0:6562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788793832.246349:0:6505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788793832.250463:0:6505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788793832.250526:0:6505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788793832.260659:0:6562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788793832.260754:0:6562:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788793832.260759:0:6562:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788793832.265566:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788793832.265855:0:6505:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788793832.268926:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788793832.269107:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788793832.274506:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788793832.274709:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788793832.274853:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788793832.276359:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788793832.276542:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788793832.276681:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788793832.276824:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788793832.279568:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788793832.279786:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788793832.279933:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788793832.281428:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788793832.281600:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788793832.281780:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788793832.285659:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788793832.286065:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788793832.286335:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788793832.286478:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788793832.286619:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788793832.286756:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788793832.286936:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788793832.287075:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788793832.289314:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788793832.293896:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788793832.297618:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788793832.297818:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788793832.297963:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788793832.298099:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788793832.299355:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788793832.299565:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788793832.299699:0:6505:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788793832.302068:0:6505:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788793832.318670:0:6505:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788793832.318722:0:6505:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7eac194f988 00100000:10000000:2.0:1788793832.318731:0:6505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788793832.322829:0:6505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788793832.322915:0:6505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788793832.322941:0:6505:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788793832.322959:0:6505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788793832.326507:0:6505:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788793832.326691:0:6505:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788793832.779415:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793833.806570:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793834.831736:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793835.861662:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788793836.455922:0:6806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788793836.892390:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788793837.387285:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788793837.387295:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788793837.387298:0:38:0:(import.c:65:import_set_state_nolock()) 000000009b9b410d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788793837.387315:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009b9b410d using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1788793837.387333:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8205aed x1875685729635584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788793837.387369:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8205aed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1875685729635584:0@lo:38: 00000100:00100000:1.0:1788793837.387460:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793837.387665:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc10014c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729635456:0@lo:400: 00000100:00100000:3.0:1788793837.387700:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793837.387747:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635584 00000100:00100000:3.0:1788793837.387755:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635584 00000100:00100000:3.0:1788793837.387798:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788793837.387804:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3f78d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3460:x1875685729635584:12345-0@lo:38: 00010000:00080000:3.0:1788793837.387829:0:6531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:3.0:1788793837.387880:0:6531:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x962a5e377b33a825 00000004:00100000:3.0:1788793837.387942:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788793837.388085:0:6531:0:(import.c:65:import_set_state_nolock()) 0000000063d5e35d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793837.388185:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3f78d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1875685729635584:12345-0@lo:38: Request processed in 379us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793837.388192:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788793837.388428:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635456 00000100:00100000:1.0:1788793837.388433:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635456 00000100:00100000:1.0:1788793837.388470:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788793837.388475:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001bfa9059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3463:x1875685729635456:12345-0@lo:400: 00000100:00100000:1.0:1788793837.388510:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001bfa9059 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3463:x1875685729635456:12345-0@lo:400: Request processed in 35us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793837.388516:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788793837.388551:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc10014c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729635456:0@lo:400: 00010000:00080000:1.0:1788793837.388585:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a8205aed x1875685729635584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788793847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788793837.388597:0:3460:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788793837.388603:0:3460:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788793837.388607:0:3460:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788793837.388609:0:3460:0:(import.c:65:import_set_state_nolock()) 000000009b9b410d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788793837.388613:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8205aed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3460:1875685729635584:0@lo:38: 00000020:00000004:2.0:1788793837.634402:0:6858:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788793837.634639:0:6858:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788793837.906584:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793838.923839:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788793839.435557:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788793839.435564:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af4dfc78000 from 3 10000000:01000000:1.0:1788793839.435570:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788793839.435616:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793839.435628:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793839.435639:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793839.435663:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8205aed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729635712:0@lo:101: 00000100:00100000:1.0:1788793839.435745:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793839.435881:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5afa201 going to sleep for 11 seconds 00000100:00100000:3.0:1788793839.439060:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635712 00000100:00100000:3.0:1788793839.439076:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635712 00000100:00100000:3.0:1788793839.439336:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788793839.439347:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013cece15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6526:x1875685729635712:12345-0@lo:101: 00010000:00010000:3.0:1788793839.439365:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793839.439383:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5306551/0x962a5e377b33a833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a82c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793839.439425:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5306551/0x962a5e377b33a833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a82c expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793839.439436:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5306551/0x962a5e377b33a833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a82c expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793839.439445:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5306551, rc 0) 00000100:00100000:3.0:1788793839.439537:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013cece15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729635712:12345-0@lo:101: Request processed in 193us (3793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793839.439544:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788793839.439657:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8205aed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729635712:0@lo:101: 00010000:00010000:2.0:1788793839.439685:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793839.439695:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793839.439775:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729635840:0@lo:256: 00000100:00100000:2.0:1788793839.439811:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793839.444689:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d441e3bf going to sleep for 11 seconds 00000100:00100000:1.0:1788793839.445064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635840 00000100:00100000:1.0:1788793839.445074:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635840 00000100:00100000:1.0:1788793839.445205:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788793839.445216:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006babf4f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729635840:12345-0@lo:256: 20000000:01000000:1.0:1788793839.445242:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788793839.445264:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788793839.445272:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788793839.445636:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006babf4f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729635840:12345-0@lo:256: Request processed in 421us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793839.445644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788793839.447914:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb7a159d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729635840:0@lo:256: 10000000:01000000:2.0:1788793839.447987:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788793839.447997:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793839.448007:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000004c009880/0x962a5e377b33a82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793839.947294:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788793840.618822:0:6960:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788793840.619026:0:6960:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788793840.971427:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788793841.773919:0:7009:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4ad81010 20000000:00000080:0.0:1788793841.773940:0:7009:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af501907800 uarg=0000000000000000 20000000:01000000:0.0:1788793841.773983:0:7009:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788793841.773991:0:7009:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788793841.773996:0:7009:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788793841.774074:0:7009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788793841.774502:0:7009:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788793841.792798:0:7009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788793841.793099:0:7009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788793841.793175:0:7009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788793841.793199:0:7009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788793841.793218:0:7009:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788793841.793244:0:7009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.793263:0:7009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.793270:0:7009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.793322:0:7009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.793335:0:7009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 11 pid: 6523 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793841.793351:0:7009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023f5b7de pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7009:1875685729635968:0@lo:104: 00000100:00100000:0.0:1788793841.793411:0:7009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793841.793846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729635968 00000100:00100000:2.0:1788793841.793856:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729635968 00000100:00100000:2.0:1788793841.793908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793841.793916:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016f6da1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:7009:x1875685729635968:12345-0@lo:104: 00010000:00010000:2.0:1788793841.793928:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793841.800914:0:7009:0:(client.c:2716:ptlrpc_set_wait()) set 00000000587bc038 going to sleep for 11 seconds 00010000:00010000:3.0:1788793841.803034:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793841.803048:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016f6da1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:7009:x1875685729635968:12345-0@lo:104: Request processed in 9129us (9633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793841.803061:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788793841.803311:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793841.803319:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.803331:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5e7b22b already unused, calling callback (00000000f6960efc) 10000000:00010000:0.0:1788793841.803334:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.803344:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793841.803351:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793841.803357:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788793841.803404:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.803412:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793841.803447:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.803473:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 00000000f5e7b22b/0x962a5e377b33a7f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a7fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793841.803492:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793841.803494:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793841.803496:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793841.803504:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788793841.803518:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078446378 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729636096:0@lo:103: 00000100:00100000:1.0:1788793841.803911:0:7009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023f5b7de pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7009:1875685729635968:0@lo:104: 00010000:00010000:1.0:1788793841.803952:0:7009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793841.804939:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793841.805067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636096 00000100:00100000:3.0:1788793841.805096:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636096 00010000:00010000:3.0:1788793841.805159:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 12 pid: 6523 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793841.805197:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788793841.805206:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7a159d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3463:x1875685729636096:12345-0@lo:103: 00010000:00010000:3.0:1788793841.805328:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793841.805334:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 12 pid: 6523 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805345:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 12 pid: 6523 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805361:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2319115/0x962a5e377b33a7fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a7f4 expref: 12 pid: 6523 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805375:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805383:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805398:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805404:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805409:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805415:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805495:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003913b70 already unused, calling callback (00000000b72af411) 00010000:00010000:3.0:1788793841.805498:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805506:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805524:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793841.805534:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788793841.805639:0:7009:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793841.805648:0:7009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793841.805653:0:7009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003913b70/0x962a5e377b33a83a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793841.806714:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7a159d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3463:x1875685729636096:12345-0@lo:103: Request processed in 1505us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793841.806725:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793841.806849:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078446378 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729636096:0@lo:103: 00010000:00010000:3.0:1788793841.998717:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793842.508025:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc10014c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729636224:0@lo:400: 00000100:00100000:3.0:1788793842.508119:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793842.508210:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793842.508217:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f23a9a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729636352:0@lo:400: 00000100:00100000:3.0:1788793842.508249:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793842.509904:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636352 00000100:00100000:0.0:1788793842.509916:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636352 00000100:00100000:0.0:1788793842.509966:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793842.509974:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024cae2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729636352:12345-0@lo:400: 00000100:00100000:0.0:1788793842.510041:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024cae2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729636352:12345-0@lo:400: Request processed in 69us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793842.510048:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788793842.510084:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f23a9a2 x1875685729636352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793842.510099:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f23a9a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729636352:0@lo:400: 00000100:00100000:1.0:1788793842.510926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636224 00000100:00100000:1.0:1788793842.510933:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636224 00000100:00100000:1.0:1788793842.510985:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788793842.510993:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000741a3a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3461:x1875685729636224:12345-0@lo:400: 00000100:00100000:1.0:1788793842.511043:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000741a3a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3461:x1875685729636224:12345-0@lo:400: Request processed in 52us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793842.511049:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788793842.511162:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc10014c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729636224:0@lo:400: 00010000:00010000:0.0:1788793843.019424:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793844.043993:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793845.079025:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793846.092703:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788793846.603287:0:6526:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788793846.603299:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af4dfc78000 from 1 10000000:01000000:2.0:1788793846.603306:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788793846.603427:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000fa875bc0/0x962a5e377b33a841 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793846.603440:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000fa875bc0/0x962a5e377b33a841 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793846.603454:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000fa875bc0/0x962a5e377b33a841 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793846.603478:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ad2e4d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729636480:0@lo:101: 00000100:00100000:2.0:1788793846.603548:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793846.603897:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8b44c10 going to sleep for 11 seconds 00000100:00100000:0.0:1788793846.617324:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636480 00000100:00100000:0.0:1788793846.617349:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636480 00000100:00100000:0.0:1788793846.617485:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793846.617494:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000481c23a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:6526:x1875685729636480:12345-0@lo:101: 00010000:00010000:0.0:1788793846.617521:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793846.617540:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003913b70/0x962a5e377b33a848 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a841 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793846.617567:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003913b70/0x962a5e377b33a848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a841 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793846.617578:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003913b70/0x962a5e377b33a848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a841 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793846.617587:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003913b70, rc 0) 00000100:00100000:0.0:1788793846.617676:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000481c23a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729636480:12345-0@lo:101: Request processed in 183us (14128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793846.617683:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793846.617737:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ad2e4d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729636480:0@lo:101: 00010000:00010000:0.0:1788793846.617759:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000fa875bc0/0x962a5e377b33a841 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793846.617771:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000fa875bc0/0x962a5e377b33a841 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793846.617882:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0bc2d2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729636608:0@lo:501: 00000100:00100000:0.0:1788793846.617917:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793846.617952:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000219342cf going to sleep for 11 seconds 00000100:00100000:0.0:1788793846.617967:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636608 00000100:00100000:0.0:1788793846.617971:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636608 00000100:00100000:0.0:1788793846.617990:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788793846.617995:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078478042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729636608:12345-0@lo:501: 00000100:00100000:0.0:1788793846.618103:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078478042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729636608:12345-0@lo:501: Request processed in 108us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793846.618110:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788793846.618171:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0bc2d2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729636608:0@lo:501: 00000100:00100000:0.0:1788793846.618210:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0bc2d2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729636736:0@lo:503: 00000100:00100000:0.0:1788793846.618247:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793846.618259:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000219342cf going to sleep for 11 seconds 00000100:00100000:0.0:1788793846.618271:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636736 00000100:00100000:0.0:1788793846.618274:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636736 00000100:00100000:0.0:1788793846.618289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788793846.618294:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac73e2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729636736:12345-0@lo:503: 00000100:00100000:0.0:1788793846.618366:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac73e2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729636736:12345-0@lo:503: Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793846.618373:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788793846.618411:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0bc2d2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729636736:0@lo:503: 00000100:00100000:2.0:1788793846.622633:0:7183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000158ae7a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7183:1875685729636864:0@lo:502: 00000100:00100000:2.0:1788793846.622737:0:7183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793846.622790:0:7183:0:(client.c:2716:ptlrpc_set_wait()) set 000000002eb4289f going to sleep for 11 seconds 00000100:00100000:0.0:1788793846.622917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636864 00000100:00100000:0.0:1788793846.622925:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636864 00000100:00100000:0.0:1788793846.622980:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788793846.622988:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d0303cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7183:x1875685729636864:12345-0@lo:502: 00000100:00100000:0.0:1788793846.623095:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d0303cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7183:x1875685729636864:12345-0@lo:502: Request processed in 108us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793846.623103:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788793846.623257:0:7183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000158ae7a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7183:1875685729636864:0@lo:502: 00000020:01000000:2.0:1788793846.623288:0:7183:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793846.623296:0:7183:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793846.623298:0:7183:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788793846.623304:0:7183:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af4dfc78000 00000020:00000080:2.0:1788793846.623306:0:7183:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788793846.623401:0:7183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7183:1875685729636992:0@lo:502: 00000100:00100000:2.0:1788793846.623435:0:7183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793846.623450:0:7183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793846.624491:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729636992 00000100:00100000:0.0:1788793846.624500:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729636992 00000100:00100000:0.0:1788793846.624548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788793846.624557:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7183:x1875685729636992:12345-0@lo:502: 00000100:00100000:0.0:1788793846.624680:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7183:x1875685729636992:12345-0@lo:502: Request processed in 123us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793846.624687:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788793846.624823:0:7183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7183:1875685729636992:0@lo:502: 00000020:01000000:2.0:1788793846.624865:0:7183:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793846.624870:0:7183:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793846.624872:0:7183:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788793846.624876:0:7183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788793846.626115:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788793846.626180:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788793846.626191:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793846.626214:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793847.117247:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793847.640539:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729637120:0@lo:400: 00000100:00100000:2.0:1788793847.640627:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793847.640692:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788793847.640699:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729637248:0@lo:400: 00000100:00100000:2.0:1788793847.640733:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793847.640777:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637248 00000100:00100000:2.0:1788793847.640784:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637248 00000100:00100000:2.0:1788793847.640838:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793847.640846:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729637248:12345-0@lo:400: 00000100:00100000:2.0:1788793847.640902:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729637248:12345-0@lo:400: Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793847.640910:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788793847.640957:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af501aae300 x1875685729637248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793847.640969:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729637248:0@lo:400: 00000100:00100000:0.0:1788793847.641083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637120 00000100:00100000:0.0:1788793847.641088:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637120 00000100:00100000:0.0:1788793847.641120:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788793847.641155:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3463:x1875685729637120:12345-0@lo:400: 00000100:00100000:0.0:1788793847.641405:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3463:x1875685729637120:12345-0@lo:400: Request processed in 252us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793847.641413:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788793847.642316:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729637120:0@lo:400: 00010000:00010000:2.0:1788793848.144345:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793849.164264:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793850.190249:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793851.220576:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793852.240083:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793852.747983:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729637504:0@lo:400: 00000100:00100000:2.0:1788793852.748100:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793852.748219:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788793852.748226:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729637376:0@lo:400: 00000100:00100000:2.0:1788793852.748265:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793852.748299:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637376 00000100:00100000:2.0:1788793852.748307:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637376 00000100:00100000:2.0:1788793852.748352:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788793852.748360:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3462:x1875685729637376:12345-0@lo:400: 00000100:00100000:2.0:1788793852.748412:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3462:x1875685729637376:12345-0@lo:400: Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793852.748419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788793852.748469:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729637376:0@lo:400: 00000100:00100000:3.0:1788793852.749022:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637504 00000100:00100000:3.0:1788793852.749028:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637504 00000100:00100000:3.0:1788793852.749069:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788793852.749077:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729637504:12345-0@lo:400: 00000100:00100000:3.0:1788793852.749164:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729637504:12345-0@lo:400: Request processed in 88us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793852.749170:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788793852.749212:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af4c4085c00 x1875685729637504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793852.749224:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729637504:0@lo:400: 00010000:00010000:0.0:1788793853.260179:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788793853.618813:0:7510:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788793853.618817:0:7510:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788793853.618819:0:7510:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788793853.618942:0:7510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af501bb0000 00000020:01000004:3.0:1788793853.620154:0:7510:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788793853.620167:0:7510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788793853.620195:0:7510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9af4ce4c8000) 00000020:00000080:3.0:1788793853.620212:0:7510:0:(obd_config.c:716:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788793853.673227:0:7510:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788793853.673284:0:7510:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788793853.722095:0:7510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788793853.724116:0:7510:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788793853.724151:0:7510:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788793853.724163:0:7510:0:(genops.c:1375:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x962a5e377b33a856 00000020:01000004:3.0:1788793853.724338:0:7510:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788793853.724359:0:7510:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788793853.724362:0:7510:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788793853.724368:0:7510:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788793853.724373:0:7510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788793853.724386:0:7510:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9af4ce4c99e8) 00000020:00000080:3.0:1788793853.724397:0:7510:0:(obd_config.c:716:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788793853.727979:0:7510:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793853.730329:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788793853.730342:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788793853.732363:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788793853.732376:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788793853.747966:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788793853.747980:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788793853.754175:0:7510:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793853.754371:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788793853.754378:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788793853.756154:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788793853.756165:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788793853.812589:0:7510:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793853.812980:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788793853.812988:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788793853.816987:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788793853.817000:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788793853.821034:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788793853.821049:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788793853.825802:0:7510:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793853.826054:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788793853.826061:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788793853.827087:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788793853.827096:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788793853.940761:0:7510:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793853.941462:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788793853.941468:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788793853.948085:0:7510:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788793853.948104:0:7510:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788793853.958444:0:7510:0:(obd_config.c:813:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788793853.958489:0:7510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788793853.958500:0:7510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788793854.002353:0:7510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788793854.002391:0:7510:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788793854.002396:0:7510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788793854.002397:0:7510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788793854.002399:0:7510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793854.002400:0:7510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793854.002401:0:7510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793854.002402:0:7510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793854.002403:0:7510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788793854.002405:0:7510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793854.002406:0:7510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793854.002407:0:7510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793854.002409:0:7510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788793854.002412:0:7510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788793854.002414:0:7510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788793854.002415:0:7510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788793854.002416:0:7510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793854.002417:0:7510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793854.002419:0:7510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793854.002420:0:7510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793854.002421:0:7510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788793854.002422:0:7510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793854.002423:0:7510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793854.002424:0:7510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793854.002425:0:7510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788793854.002449:0:7510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788793854.002468:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729637632:0@lo:253: 00000100:00100000:0.0:1788793854.002556:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793854.002603:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9f9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.002900:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637632 00000100:00100000:2.0:1788793854.002908:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637632 00000100:00100000:2.0:1788793854.002962:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788793854.002971:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729637632:12345-0@lo:253: 20000000:01000000:2.0:1788793854.003000:0:6523:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788793854.003006:0:6523:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788793854.003017:0:6523:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788793854.003020:0:6523:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788793854.003242:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793854.003349:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788793854.003363:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788793854.003380:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788793854.003387:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788793854.003398:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788793854.003412:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788793854.003523:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788793854.003539:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1788793854.003542:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1788793854.003556:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788793854.003563:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788793854.003575:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788793854.003580:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1788793854.003592:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788793854.003599:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788793854.003612:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788793854.003627:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788793854.003961:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788793854.003973:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1788793854.003974:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1788793854.003986:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788793854.003991:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788793854.004002:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788793854.004006:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1788793854.004019:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788793854.004024:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788793854.004035:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788793854.004049:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788793854.004060:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788793854.004068:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788793854.004071:0:6523:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788793854.004114:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788793854.004117:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788793854.009745:0:7529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788793854.009792:0:7529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788793854.009806:0:7529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788793854.010092:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788793854.010118:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788793854.010169:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788793854.010181:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788793854.010184:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788793854.010609:0:7530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788793854.010627:0:7530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788793854.010639:0:7530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788793854.010766:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788793854.010786:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788793854.010820:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788793854.010830:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788793854.010832:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788793854.017096:0:7531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788793854.018835:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788793854.018936:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788793854.018952:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788793854.018970:0:6523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788793854.018991:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019010:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a776 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019018:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a792 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019024:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a802 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019031:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019068:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a802 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019083:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a802 expref: 12 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.019097:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729637760:0@lo:104: 00000100:00100000:0.0:1788793854.019311:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793854.019404:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a792 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019428:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a792 expref: 12 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.019437:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729637888:0@lo:104: 00000100:00100000:0.0:1788793854.019461:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793854.019690:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a776 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.019698:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a776 expref: 12 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.019707:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729638016:0@lo:104: 00000100:00100000:0.0:1788793854.019727:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.026220:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637760 00000100:00100000:3.0:1788793854.026237:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637760 00000100:00100000:3.0:1788793854.026287:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729637888 00000100:00100000:3.0:1788793854.026291:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729637888 00000100:00100000:3.0:1788793854.026308:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788793854.026318:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:6523:x1875685729637760:12345-0@lo:104: 00010000:00010000:3.0:1788793854.026335:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.026431:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793854.026438:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:6523:x1875685729637760:12345-0@lo:104: Request processed in 122us (7128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793854.026445:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788793854.026463:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788793854.026479:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729637888:12345-0@lo:104: 00010000:00010000:3.0:1788793854.026487:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.026529:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788793854.026534:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729637888:12345-0@lo:104: Request processed in 66us (7073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793854.026540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788793854.026592:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788793854.026600:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026609:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1512600 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:2.0:1788793854.026613:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026621:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793854.026629:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793854.026636:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788793854.026675:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026681:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793854.026701:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026726:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1512600/0x962a5e377b33a802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a809 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026740:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788793854.026743:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026749:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513c00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:2.0:1788793854.026752:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026759:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793854.026765:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793854.026770:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788793854.026782:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026787:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793854.026793:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026799:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513c00/0x962a5e377b33a792 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a799 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.026808:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793854.026814:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793854.026815:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793854.026830:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729638144:0@lo:103: 00000100:00100000:2.0:1788793854.026926:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.026979:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788793854.026985:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729638272:0@lo:103: 00000100:00100000:2.0:1788793854.027007:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.027036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638144 00000100:00100000:2.0:1788793854.027040:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638144 00010000:00010000:2.0:1788793854.027062:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a802 expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793854.027081:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638272 00000100:00100000:2.0:1788793854.027084:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638272 00010000:00010000:2.0:1788793854.027096:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a792 expref: 14 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793854.027109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788793854.027116:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3463:x1875685729638144:12345-0@lo:103: 00010000:00010000:2.0:1788793854.027167:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793854.027174:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a802 expref: 14 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.027183:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a802 expref: 14 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.027200:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793854.027230:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3463:x1875685729638144:12345-0@lo:103: Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.027236:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788793854.027258:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793854.027263:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3463:x1875685729638272:12345-0@lo:103: 00010000:00010000:2.0:1788793854.027270:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793854.027274:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a792 expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.027282:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a792 expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.027291:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793854.027309:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3463:x1875685729638272:12345-0@lo:103: Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.027314:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793854.027358:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729638272:0@lo:103: 00000100:00100000:2.0:1788793854.027366:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729638144:0@lo:103: 00010000:00010000:0.0:1788793854.027589:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793854.027625:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c2a340c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788793854.027640:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b600/0x962a5e377b33a809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a802 expref: 12 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.027650:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729637760:0@lo:104: 00010000:00010000:0.0:1788793854.027661:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a792 expref: 11 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.027670:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729637888:0@lo:104: 00000100:00100000:3.0:1788793854.027720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638016 00000100:00100000:3.0:1788793854.027725:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638016 00000100:00100000:3.0:1788793854.027748:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788793854.027754:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729638016:12345-0@lo:104: 00010000:00010000:3.0:1788793854.027763:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.027824:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793854.027830:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729638016:12345-0@lo:104: Request processed in 76us (8101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793854.027836:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788793854.027931:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788793854.027937:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.027944:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513800 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:2.0:1788793854.027947:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.027955:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793854.027961:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793854.027980:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788793854.028011:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028018:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793854.028037:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028044:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a77d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028056:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793854.028057:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793854.028059:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793854.028065:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788793854.028075:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729638400:0@lo:103: 00000100:00100000:2.0:1788793854.028102:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.028154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638400 00000100:00100000:2.0:1788793854.028158:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638400 00010000:00010000:2.0:1788793854.028173:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a776 expref: 11 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793854.028193:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788793854.028199:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3462:x1875685729638400:12345-0@lo:103: 00010000:00010000:2.0:1788793854.028206:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793854.028211:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a776 expref: 11 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028219:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a776 expref: 11 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028238:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028247:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028261:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028269:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028275:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028282:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028288:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c0030e00 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:2.0:1788793854.028293:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028300:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028308:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.028318:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793854.028346:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3462:x1875685729638400:12345-0@lo:103: Request processed in 147us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.028361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788793854.028389:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729638400:0@lo:103: 00010000:00010000:0.0:1788793854.028525:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c0031a00/0x962a5e377b33a77d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a776 expref: 10 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.028536:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729638016:0@lo:104: 00010000:00010000:0.0:1788793854.028554:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.028569:0:6523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.028575:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.028580:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a864 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788793854.028593:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788793854.033910:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:7510:x1875685729637632:12345-0@lo:253: Request processed in 30930us (31344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.033924:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788793854.034026:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729637632:0@lo:253: 10000000:01000000:2.0:1788793854.034042:0:7510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788793854.034046:0:7510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788793854.034048:0:7510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788793854.034049:0:7510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793854.034050:0:7510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788793854.034051:0:7510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793854.034053:0:7510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793854.034054:0:7510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793854.034056:0:7510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788793854.034057:0:7510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793854.034059:0:7510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788793854.034081:0:7510:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af501bb0000 from lustre-OST0000 10000000:01000000:2.0:1788793854.034112:0:7510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788793854.034115:0:7510:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788793854.034152:0:7510:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9af4ce6799e8 local copy 10000000:01000000:2.0:1788793854.034157:0:7510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788793854.034190:0:7510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.034201:0:7510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.034210:0:7510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793854.034227:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638528:0@lo:101: 00000100:00100000:2.0:1788793854.034291:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.034325:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fa99d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788793854.034392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638528 00000100:00100000:0.0:1788793854.034399:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638528 00000100:00100000:0.0:1788793854.034444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788793854.034452:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:7510:x1875685729638528:12345-0@lo:101: 00010000:00010000:0.0:1788793854.034464:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793854.034486:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a86b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.034508:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a86b expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.034518:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a86b expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.034526:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c0030c00, rc 0) 00000100:00100000:0.0:1788793854.034572:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:7510:x1875685729638528:12345-0@lo:101: Request processed in 121us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.034585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788793854.034682:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638528:0@lo:101: 00010000:00010000:3.0:1788793854.034695:0:7510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.034705:0:7510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793854.034791:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638656:0@lo:501: 00000100:00100000:3.0:1788793854.034818:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.034842:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788793854.034886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638656 00000100:00100000:0.0:1788793854.034890:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638656 00000100:00100000:0.0:1788793854.034917:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788793854.034923:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:7510:x1875685729638656:12345-0@lo:501: 00000100:00100000:0.0:1788793854.034977:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:7510:x1875685729638656:12345-0@lo:501: Request processed in 54us (158us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788793854.034984:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788793854.035039:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638656:0@lo:501: 10000000:01000000:3.0:1788793854.035051:0:7510:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788793854.035066:0:7510:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788793854.035071:0:7510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035079:0:7510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035086:0:7510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035119:0:7510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788793854.035165:0:7510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af501bb0000 10000000:01000000:3.0:1788793854.035170:0:7510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788793854.035175:0:7510:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9af4ce6799e8 10000000:01000000:3.0:1788793854.035177:0:7510:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788793854.035181:0:7510:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9af4ce6799e8 from 1 10000000:01000000:3.0:1788793854.035183:0:7510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788793854.035198:0:7510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035205:0:7510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035212:0:7510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793854.035224:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638784:0@lo:101: 00000100:00100000:3.0:1788793854.035246:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.035268:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.035333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638784 00000100:00100000:2.0:1788793854.035339:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638784 00000100:00100000:2.0:1788793854.035374:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788793854.035382:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+10:7510:x1875685729638784:12345-0@lo:101: 00010000:00010000:2.0:1788793854.035390:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793854.035400:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1513c00/0x962a5e377b33a880 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a879 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.035414:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1513c00/0x962a5e377b33a880 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a879 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.035423:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1513c00/0x962a5e377b33a880 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a879 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.035430:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1513c00, rc 0) 00000100:00100000:2.0:1788793854.035466:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729638784:12345-0@lo:101: Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.035480:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788793854.035546:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638784:0@lo:101: 00010000:00010000:3.0:1788793854.035557:0:7510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a880 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035565:0:7510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a880 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793854.035577:0:7510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788793854.035593:0:7510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a880 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035607:0:7510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0200/0x962a5e377b33a879 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a880 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793854.035614:0:7510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788793854.035617:0:7510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788793854.035621:0:7510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788793854.035623:0:7510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788793854.035637:0:7510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035644:0:7510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.035652:0:7510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793854.035664:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638912:0@lo:101: 00000100:00100000:3.0:1788793854.035695:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.035723:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089780 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.035748:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729638912 00000100:00100000:1.0:1788793854.035763:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729638912 00000100:00100000:1.0:1788793854.035839:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788793854.035849:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729638912:12345-0@lo:101: 00010000:00010000:1.0:1788793854.035876:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793854.035893:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a887 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.035931:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a887 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.035943:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a887 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.035953:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a800, rc 0) 00000100:00100000:1.0:1788793854.036025:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729638912:12345-0@lo:101: Request processed in 178us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.036033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788793854.039752:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729638912:0@lo:101: 00010000:00010000:3.0:1788793854.039786:0:7510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.039801:0:7510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793854.039927:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639040:0@lo:501: 00000100:00100000:3.0:1788793854.040003:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.040047:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.040177:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639040 00000100:00100000:2.0:1788793854.040184:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639040 00000100:00100000:2.0:1788793854.040223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788793854.040233:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639040:12345-0@lo:501: 00000100:00100000:2.0:1788793854.040344:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639040:12345-0@lo:501: Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.040352:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788793854.041312:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793854.041324:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.041334:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513800 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793854.041337:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.041346:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793854.041352:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793854.041358:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793854.041387:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.041393:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793854.041428:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.041450:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a86b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x962a5e377b33a872 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.041463:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793854.041465:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793854.041467:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793854.041485:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788793854.041500:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729639168:0@lo:103: 00000100:00100000:0.0:1788793854.041543:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793854.041595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639168 00000100:00100000:0.0:1788793854.041600:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639168 00000100:00100000:0.0:1788793854.041643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793854.041652:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3461:x1875685729639168:12345-0@lo:103: 00010000:00010000:0.0:1788793854.041665:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793854.041680:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c0030c00/0x962a5e377b33a872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x962a5e377b33a86b expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.041693:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793854.041731:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3461:x1875685729639168:12345-0@lo:103: Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.041738:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793854.041789:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729639168:0@lo:103: 00000100:00100000:3.0:1788793854.041927:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639040:0@lo:501: 00000100:00100000:3.0:1788793854.041959:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639296:0@lo:503: 00000100:00100000:3.0:1788793854.042000:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.042021:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.042109:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639296 00000100:00100000:2.0:1788793854.042147:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639296 00000100:00100000:2.0:1788793854.042177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788793854.042184:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639296:12345-0@lo:503: 00000100:00100000:2.0:1788793854.042278:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639296:12345-0@lo:503: Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.042286:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788793854.042347:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639296:0@lo:503: 00000040:00080000:2.0:1788793854.042591:0:7510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788793854.042652:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639424:0@lo:502: 00000100:00100000:2.0:1788793854.042687:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.042717:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9f9fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.042761:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639424 00000100:00100000:1.0:1788793854.042775:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639424 00000100:00100000:1.0:1788793854.042837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788793854.042849:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639424:12345-0@lo:502: 00000100:00100000:1.0:1788793854.043035:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639424:12345-0@lo:502: Request processed in 187us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.043045:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788793854.043288:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639424:0@lo:502: 00000040:00080000:3.0:1788793854.043500:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788793854.043527:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788793854.043542:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788793854.043557:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788793854.043570:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788793854.043583:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788793854.043604:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639552:0@lo:502: 00000100:00100000:3.0:1788793854.043647:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.043683:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089000 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.044653:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639552 00000100:00100000:2.0:1788793854.044662:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639552 00000100:00100000:2.0:1788793854.044715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788793854.044724:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639552:12345-0@lo:502: 00000100:00100000:2.0:1788793854.044862:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639552:12345-0@lo:502: Request processed in 138us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.044869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788793854.045008:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639552:0@lo:502: 00000040:00080000:3.0:1788793854.045085:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788793854.045095:0:7510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788793854.051247:0:7532:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788793854.051260:0:7532:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788793854.051268:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793854.051270:0:7532:0:(obd_config.c:1547:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788793854.051279:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793854.051297:0:7532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9af4c482b3d0) 00000020:00000080:2.0:1788793854.051320:0:7532:0:(obd_config.c:716:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788793854.051326:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788793854.052275:0:7532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af501bb0000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788793854.052300:0:7532:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788793854.052310:0:7532:0:(genops.c:1375:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x962a5e377b33a89c 00010000:00010000:2.0:1788793854.062697:0:7532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788793854.062974:0:7532:0:(tgt_lastrcvd.c:1869:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788793854.066556:0:7532:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788793854.067041:0:7532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788793854.075358:0:7532:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788793854.075578:0:7532:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788793854.079727:0:7532:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788793854.080479:0:7532:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788793854.080490:0:7532:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793854.080496:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793854.080498:0:7532:0:(obd_config.c:1547:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788793854.080501:0:7532:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793854.080505:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793854.080512:0:7532:0:(obd_config.c:1547:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788793854.080516:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788793854.080518:0:7532:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788793854.080537:0:7532:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793854.080539:0:7532:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793854.080541:0:7532:0:(obd_config.c:1547:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788793854.080544:0:7532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788793854.082681:0:7510:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788793854.082738:0:7510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788793854.082763:0:7510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.082779:0:7510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793854.082798:0:7510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af501bb0000 from 1 10000000:01000000:3.0:1788793854.082801:0:7510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788793854.082837:0:7510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.082845:0:7510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.082868:0:7510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793854.082890:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639680:0@lo:101: 00000100:00100000:3.0:1788793854.082949:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.082995:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.083287:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639680 00000100:00100000:2.0:1788793854.083294:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639680 00000100:00100000:2.0:1788793854.083362:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788793854.083370:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:7510:x1875685729639680:12345-0@lo:101: 00010000:00010000:2.0:1788793854.083381:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793854.083390:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a8a3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.083409:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.083416:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.083422:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512600, rc 0) 00000100:00100000:2.0:1788793854.083457:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639680:12345-0@lo:101: Request processed in 88us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.083463:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788793854.083514:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639680:0@lo:101: 00010000:00010000:3.0:1788793854.083528:0:7510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.083537:0:7510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793854.083733:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639808:0@lo:501: 00000100:00100000:3.0:1788793854.083754:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793854.083776:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793854.083790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639808 00000100:00100000:0.0:1788793854.083795:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639808 00000100:00100000:0.0:1788793854.083855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788793854.083863:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639808:12345-0@lo:501: 00000100:00100000:0.0:1788793854.083974:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639808:12345-0@lo:501: Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.083981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788793854.084035:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639808:0@lo:501: 00000100:00100000:2.0:1788793854.084070:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639936:0@lo:503: 00000100:00100000:2.0:1788793854.084106:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.084315:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.084344:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729639936 00000100:00100000:1.0:1788793854.084349:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729639936 00000100:00100000:1.0:1788793854.084370:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788793854.084376:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639936:12345-0@lo:503: 00000100:00100000:1.0:1788793854.084452:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729639936:12345-0@lo:503: Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.084459:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788793854.084580:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729639936:0@lo:503: 00000040:00080000:2.0:1788793854.084805:0:7510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788793854.084872:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640064:0@lo:502: 00000100:00100000:2.0:1788793854.084903:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.084965:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.084999:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640064 00000100:00100000:1.0:1788793854.085003:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640064 00000100:00100000:1.0:1788793854.085424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788793854.085434:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729640064:12345-0@lo:502: 00000100:00100000:1.0:1788793854.085538:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729640064:12345-0@lo:502: Request processed in 106us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.085545:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788793854.085622:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640064:0@lo:502: 00000040:00080000:2.0:1788793854.085814:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788793854.085840:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788793854.085861:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640192:0@lo:502: 00000100:00100000:2.0:1788793854.085895:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.085992:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793854.086036:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640192 00000100:00100000:0.0:1788793854.086040:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640192 00000100:00100000:0.0:1788793854.086063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788793854.086069:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729640192:12345-0@lo:502: 00000100:00100000:0.0:1788793854.086164:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729640192:12345-0@lo:502: Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.086171:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788793854.086373:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640192:0@lo:502: 00000040:00080000:2.0:1788793854.086409:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788793854.086416:0:7510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788793854.086803:0:7536:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793854.086811:0:7536:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793854.086813:0:7536:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788793854.086819:0:7536:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af501bb0000 00000020:00000080:0.0:1788793854.086821:0:7536:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788793854.086831:0:7536:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788793854.086833:0:7536:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793854.086835:0:7536:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788793854.086837:0:7536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788793854.086953:0:7510:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788793854.086974:0:7510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788793854.087016:0:7510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.087027:0:7510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793854.087063:0:7510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788793854.087066:0:7510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af501bb0000 10000000:01000000:2.0:1788793854.087069:0:7510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af501bb0000 10000000:01000000:2.0:1788793854.087072:0:7510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793854.087077:0:7510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af501bb0000 from 1 10000000:01000000:2.0:1788793854.087079:0:7510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793854.087103:0:7510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.087249:0:7510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.087260:0:7510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793854.087275:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640320:0@lo:101: 00000100:00100000:2.0:1788793854.087314:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.087693:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793854.087859:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640320 00000100:00100000:3.0:1788793854.087867:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640320 00000100:00100000:3.0:1788793854.087900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788793854.087909:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:7510:x1875685729640320:12345-0@lo:101: 00010000:00010000:3.0:1788793854.087926:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793854.087938:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a8b1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.087959:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.087969:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793854.087975:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0c00, rc 0) 00000100:00100000:3.0:1788793854.088011:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640320:12345-0@lo:101: Request processed in 103us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793854.088017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788793854.088034:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640320:0@lo:101: 00010000:00010000:2.0:1788793854.088047:0:7510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.088057:0:7510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793854.088316:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640448:0@lo:501: 00000100:00100000:2.0:1788793854.088340:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.088390:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793854.088417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640448 00000100:00100000:0.0:1788793854.088421:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640448 00000100:00100000:0.0:1788793854.088483:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788793854.088490:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640448:12345-0@lo:501: 00000100:00100000:0.0:1788793854.088583:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640448:12345-0@lo:501: Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.088591:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788793854.088641:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640448:0@lo:501: 00000100:00100000:2.0:1788793854.088665:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640576:0@lo:503: 00000100:00100000:2.0:1788793854.088697:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.088766:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.088824:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640576 00000100:00100000:1.0:1788793854.088828:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640576 00000100:00100000:1.0:1788793854.088849:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788793854.088855:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640576:12345-0@lo:503: 00000100:00100000:1.0:1788793854.088934:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640576:12345-0@lo:503: Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.088940:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788793854.088997:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640576:0@lo:503: 00000040:00080000:2.0:1788793854.089208:0:7510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788793854.089269:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640704:0@lo:502: 00000100:00100000:2.0:1788793854.089294:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.089311:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.089404:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640704 00000100:00100000:1.0:1788793854.089412:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640704 00000100:00100000:1.0:1788793854.089424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788793854.089428:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640704:12345-0@lo:502: 00000100:00100000:1.0:1788793854.089508:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640704:12345-0@lo:502: Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.089515:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788793854.089582:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640704:0@lo:502: 00000040:00080000:2.0:1788793854.089751:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788793854.089773:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788793854.089786:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788793854.089800:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788793854.089812:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788793854.089822:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788793854.089834:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788793854.089847:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788793854.089860:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788793854.089874:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788793854.089886:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788793854.089908:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788793854.089923:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788793854.089936:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788793854.089948:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788793854.089961:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788793854.089974:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788793854.089987:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788793854.090002:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788793854.090013:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788793854.090024:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788793854.090036:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788793854.090048:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788793854.090060:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788793854.090071:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788793854.090083:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788793854.090094:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788793854.090162:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788793854.090185:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640832:0@lo:502: 00000100:00100000:2.0:1788793854.090219:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.090244:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793854.090363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640832 00000100:00100000:1.0:1788793854.090368:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640832 00000100:00100000:1.0:1788793854.090398:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788793854.090408:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640832:12345-0@lo:502: 00000100:00100000:1.0:1788793854.090498:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729640832:12345-0@lo:502: Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793854.090504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788793854.090572:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729640832:0@lo:502: 00000040:00080000:2.0:1788793854.090608:0:7510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788793854.090615:0:7510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788793854.091023:0:7537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788793854.091039:0:7537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9af4ce67b3d0) 00000020:00000080:0.0:1788793854.091057:0:7537:0:(obd_config.c:716:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788793854.091357:0:7537:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af501bb0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788793854.091361:0:7537:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af501bb0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788793854.091364:0:7537:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af501bb0000 3 00010000:00080000:2.0:1788793854.091387:0:7537:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af4f7330800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1788793854.093929:0:7537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788793854.094292:0:7537:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788793854.094335:0:7537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788793854.094351:0:7537:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x962a5e377b33a8c6 00000100:00080000:2.0:1788793854.094361:0:7537:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793854.094372:0:7537:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9af4f7330800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1788793854.094404:0:7537:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af4ce61ed80 x1875685729640960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788793854.094458:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3460:1875685729640960:0@lo:38: 00000100:00100000:1.0:1788793854.094547:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788793854.094623:0:7537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788793854.096330:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729640960 00000100:00100000:2.0:1788793854.096340:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729640960 00000100:00100000:2.0:1788793854.096384:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788793854.096391:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3460:x1875685729640960:12345-0@lo:38: 00010000:00080000:2.0:1788793854.096417:0:6530:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:2.0:1788793854.096459:0:6530:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x962a5e377b33a8cd 00000004:00100000:2.0:1788793854.096484:0:6530:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788793854.096518:0:6530:0:(import.c:65:import_set_state_nolock()) ffff9af4f7330000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788793854.097565:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1875685729640960:12345-0@lo:38: Request processed in 1169us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.097574:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788793854.097769:0:7537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788793854.097866:0:7510:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788793854.097895:0:7510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788793854.097910:0:7510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793854.097921:0:7510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788793854.097963:0:7510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788793854.097965:0:7510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788793854.097966:0:7510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793854.097968:0:7510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788793854.097969:0:7510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793854.097970:0:7510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793854.097972:0:7510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793854.097973:0:7510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788793854.097975:0:7510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788793854.097976:0:7510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793854.097977:0:7510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788793854.097981:0:7510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788793854.097983:0:7510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788793854.097984:0:7510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788793854.097985:0:7510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793854.097986:0:7510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788793854.097987:0:7510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793854.097988:0:7510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793854.097989:0:7510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793854.097990:0:7510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788793854.097991:0:7510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788793854.097992:0:7510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793854.097997:0:7510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788793854.098017:0:7510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788793854.098031:0:7510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729641088:0@lo:253: 00000100:00100000:2.0:1788793854.098077:0:7510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.098108:0:7510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9d989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.098381:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729641216:0@lo:400: 00000100:00100000:2.0:1788793854.098410:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793854.098444:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641216 00000100:00100000:2.0:1788793854.098449:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641216 00000100:00100000:2.0:1788793854.098492:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793854.098500:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729641216:12345-0@lo:400: 00000100:00100000:2.0:1788793854.098542:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729641216:12345-0@lo:400: Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.098548:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788793854.098583:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af501aaca80 x1875685729641216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793854.098596:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729641216:0@lo:400: 00000100:00100000:2.0:1788793854.100311:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641088 00000100:00100000:2.0:1788793854.100321:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641088 00000100:00100000:2.0:1788793854.100378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788793854.100388:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729641088:12345-0@lo:253: 20000000:01000000:2.0:1788793854.100414:0:6524:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788793854.100427:0:6524:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788793854.100658:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9af4ce61ed80 x1875685729640960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788793864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793854.100670:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788793854.100680:0:3460:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788793854.100687:0:3460:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788793854.100693:0:3460:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788793854.100697:0:3460:0:(import.c:65:import_set_state_nolock()) ffff9af4f7330800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788793854.100704:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3460:1875685729640960:0@lo:38: 20000000:01000000:2.0:1788793854.107088:0:6524:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788793854.107106:0:6524:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788793854.107214:0:6545:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788793854.107219:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788793854.107242:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.107269:0:6545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a82c expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.107278:0:6545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.107318:0:6545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a82c expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.107332:0:6545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a82c expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793854.107348:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4811180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6545:1875685729641344:0@lo:104: 00000100:00100000:1.0:1788793854.107413:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793854.107464:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c5df9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793854.107478:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7510:x1875685729641088:12345-0@lo:253: Request processed in 7080us (9388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793854.107488:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788793854.107554:0:7510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7510:1875685729641088:0@lo:253: 10000000:01000000:2.0:1788793854.107565:0:7510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788793854.107569:0:7510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788793854.107570:0:7510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788793854.107571:0:7510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793854.107573:0:7510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788793854.107574:0:7510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793854.107576:0:7510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793854.107578:0:7510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793854.107580:0:7510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788793854.107581:0:7510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788793854.107583:0:7510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793854.107585:0:7510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788793854.107598:0:7510:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788793854.110698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641344 00000100:00100000:0.0:1788793854.110714:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641344 00000100:00100000:0.0:1788793854.110782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793854.110794:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6545:x1875685729641344:12345-0@lo:104: 00010000:00010000:0.0:1788793854.110812:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.110906:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793854.110912:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6545:x1875685729641344:12345-0@lo:104: Request processed in 122us (3500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.110918:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788793854.110939:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793854.110945:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.110953:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166ba00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793854.110957:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.110966:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793854.110972:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793854.110978:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793854.111011:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111018:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793854.111049:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111057:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a82c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a833 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111074:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793854.111076:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793854.111078:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793854.111093:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729641472:0@lo:103: 00000100:00100000:0.0:1788793854.111150:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793854.111191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641472 00000100:00100000:0.0:1788793854.111195:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641472 00010000:00010000:0.0:1788793854.111213:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a82c expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793854.111234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793854.111241:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3464:x1875685729641472:12345-0@lo:103: 00010000:00010000:0.0:1788793854.111251:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793854.111257:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a82c expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111267:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a82c expref: 13 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111284:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111292:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788793854.111318:0:6514:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004712060s 00010000:00010000:0.0:1788793854.111322:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111328:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111334:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111340:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111345:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166b400 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:0.0:1788793854.111349:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111356:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111364:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793854.111373:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793854.111402:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3464:x1875685729641472:12345-0@lo:103: Request processed in 162us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793854.111408:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793854.111483:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729641472:0@lo:103: 00010000:00010000:1.0:1788793854.111613:0:6545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33a833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a82c expref: 12 pid: 6523 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793854.111625:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4811180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6545:1875685729641344:0@lo:104: 00010000:00010000:1.0:1788793854.111638:0:6545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.111647:0:6545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.111654:0:6545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793854.111661:0:6545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a8d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788793854.113550:0:7510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788793854.113744:0:7510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788793854.114035:0:7510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788793854.114221:0:7510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788793854.114450:0:7510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788793854.114817:0:7510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788793854.117528:0:7510:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788793854.126928:0:7510:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788793854.126950:0:7510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788793854.126986:0:7510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788793854.127027:0:7510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788793854.127046:0:7510:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788793854.127073:0:7510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788793854.128229:0:7510:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788793854.149906:0:7510:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788793854.286228:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788793855.057094:0:7591:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788793855.057531:0:7591:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788793855.307232:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793856.352396:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793857.359160:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793858.379365:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793859.404824:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793859.405297:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729641728:0@lo:400: 00000100:00100000:1.0:1788793859.405364:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793859.405433:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788793859.405440:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729641600:0@lo:400: 00000100:00100000:1.0:1788793859.405470:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793859.405498:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788793859.405505:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1875685729641856:0@lo:400: 00000100:00100000:1.0:1788793859.405529:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793859.405559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641600 00000100:00100000:1.0:1788793859.405567:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641600 00000100:00100000:1.0:1788793859.405612:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788793859.405620:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3462:x1875685729641600:12345-0@lo:400: 00000100:00100000:1.0:1788793859.405668:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3462:x1875685729641600:12345-0@lo:400: Request processed in 48us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793859.405674:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788793859.405712:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641728 00000100:00100000:1.0:1788793859.405716:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641728 00000100:00100000:1.0:1788793859.405739:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641856 00000100:00100000:1.0:1788793859.405742:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641856 00000100:00100000:1.0:1788793859.405762:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793859.405768:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729641728:12345-0@lo:400: 00000100:00100000:1.0:1788793859.405827:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729641728:12345-0@lo:400: Request processed in 58us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793859.405834:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793859.405846:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788793859.405860:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1875685729641856:12345-0@lo:400: 00000100:00100000:1.0:1788793859.405893:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1875685729641856:12345-0@lo:400: Request processed in 34us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793859.405899:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788793859.405940:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4c4810700 x1875685729641856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793859.405955:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1875685729641856:0@lo:400: 00000100:00100000:1.0:1788793859.405979:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729641600:0@lo:400: 00010000:00080000:1.0:1788793859.405988:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4c4810a80 x1875685729641728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793859.405996:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729641728:0@lo:400: 00000100:00080000:2.0:1788793859.407038:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788793860.427281:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788793861.282678:0:7881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788793861.451239:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788793862.380431:0:7933:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788793862.380621:0:7933:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788793862.475396:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788793863.499274:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788793863.499282:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4dfc78000 from 21 10000000:01000000:0.0:1788793863.499288:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788793863.499353:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793863.499366:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793863.499378:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793863.499400:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729641984:0@lo:101: 00000100:00100000:0.0:1788793863.499465:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793863.499544:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9db1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.499582:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729641984 00010000:00010000:0.0:1788793863.499591:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793863.499591:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729641984 00000100:00100000:1.0:1788793863.499639:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788793863.499649:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729641984:12345-0@lo:101: 00010000:00010000:1.0:1788793863.499661:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793863.499673:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a8db expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.499707:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a8db expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.499718:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8db expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.499727:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166b800, rc 0) 00000100:00100000:1.0:1788793863.499794:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729641984:12345-0@lo:101: Request processed in 147us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.499801:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788793863.499963:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729641984:0@lo:101: 00010000:00010000:0.0:1788793863.499977:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793863.499993:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793863.500061:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642112:0@lo:501: 00000100:00100000:0.0:1788793863.500086:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793863.500107:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9db1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.500289:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642112 00000100:00100000:1.0:1788793863.500294:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642112 00000100:00100000:1.0:1788793863.500337:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788793863.500343:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729642112:12345-0@lo:501: 00000100:00100000:1.0:1788793863.500453:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729642112:12345-0@lo:501: Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.500460:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788793863.500467:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642112:0@lo:501: 00000100:00100000:2.0:1788793863.500495:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642240:0@lo:503: 00000100:00100000:2.0:1788793863.500548:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.500576:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9339540 going to sleep for 11 seconds 00000100:00100000:3.0:1788793863.500682:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642240 00000100:00100000:3.0:1788793863.500687:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642240 00000100:00100000:3.0:1788793863.500715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788793863.500722:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729642240:12345-0@lo:503: 00000100:00100000:3.0:1788793863.500809:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729642240:12345-0@lo:503: Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793863.500815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788793863.501004:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642240:0@lo:503: 00000100:00100000:3.0:1788793863.501355:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7985:1875685729642368:0@lo:502: 00000100:00100000:3.0:1788793863.501388:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793863.501420:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d871c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.501438:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642368 00000100:00100000:1.0:1788793863.501443:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642368 00000100:00100000:1.0:1788793863.501522:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788793863.501531:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7985:x1875685729642368:12345-0@lo:502: 00000100:00100000:1.0:1788793863.501617:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7985:x1875685729642368:12345-0@lo:502: Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.501624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788793863.501703:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7985:1875685729642368:0@lo:502: 00000100:00100000:2.0:1788793863.501744:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7985:1875685729642496:0@lo:502: 00000100:00100000:2.0:1788793863.501778:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.503555:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d93390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793863.505598:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642496 00000100:00100000:3.0:1788793863.505614:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642496 00000100:00100000:3.0:1788793863.505675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788793863.505708:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7985:x1875685729642496:12345-0@lo:502: 00000100:00100000:3.0:1788793863.505876:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:7985:x1875685729642496:12345-0@lo:502: Request processed in 169us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793863.505884:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788793863.506634:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7985:1875685729642496:0@lo:502: 00000040:00080000:2.0:1788793863.506676:0:7985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788793863.508093:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788793863.508216:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788793863.508404:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793863.508418:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793863.508646:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788793863.508649:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af4dfc78000 from 4 10000000:01000000:3.0:1788793863.508652:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788793863.508767:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793863.508777:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793863.508789:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793863.508812:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642624:0@lo:101: 00000100:00100000:3.0:1788793863.508878:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793863.509653:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d871c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.509873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642624 00000100:00100000:1.0:1788793863.509882:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642624 00000100:00100000:1.0:1788793863.509946:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788793863.509956:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729642624:12345-0@lo:101: 00010000:00010000:1.0:1788793863.509970:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793863.509986:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a8e9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.510010:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.510039:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.510048:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a400, rc 0) 00000100:00100000:1.0:1788793863.510112:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729642624:12345-0@lo:101: Request processed in 156us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.510119:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788793863.510510:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642624:0@lo:101: 00010000:00010000:2.0:1788793863.510533:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.510543:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793863.510602:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642752:0@lo:256: 00000100:00100000:2.0:1788793863.510638:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.510672:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d93390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.510838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642752 00000100:00100000:1.0:1788793863.510843:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642752 00000100:00100000:1.0:1788793863.510867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788793863.510873:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729642752:12345-0@lo:256: 20000000:01000000:1.0:1788793863.510887:0:6522:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788793863.510902:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788793863.510905:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788793863.510991:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729642752:12345-0@lo:256: Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.510998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788793863.511977:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642752:0@lo:256: 10000000:01000000:2.0:1788793863.512029:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788793863.512037:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.512046:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793863.512054:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788793863.512057:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788793863.512059:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788793863.512089:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.512097:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.512106:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793863.512121:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642880:0@lo:101: 00000100:00100000:2.0:1788793863.512251:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.512283:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d93390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.512422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729642880 00000100:00100000:1.0:1788793863.512427:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729642880 00000100:00100000:1.0:1788793863.512466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788793863.512586:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729642880:12345-0@lo:101: 00010000:00010000:1.0:1788793863.512598:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793863.512614:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a8f7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.512636:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.512657:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793863.512665:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a000, rc 0) 00000100:00100000:1.0:1788793863.512881:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729642880:12345-0@lo:101: Request processed in 407us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.512888:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788793863.513336:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729642880:0@lo:101: 00010000:00010000:2.0:1788793863.513352:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.513362:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793863.513420:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729643008:0@lo:501: 00000100:00100000:2.0:1788793863.513448:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.513606:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d93390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793863.514388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643008 00000100:00100000:3.0:1788793863.514397:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643008 00000100:00100000:3.0:1788793863.514493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788793863.514516:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729643008:12345-0@lo:501: 00000100:00100000:3.0:1788793863.514679:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729643008:12345-0@lo:501: Request processed in 165us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793863.514696:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788793863.514768:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729643008:0@lo:501: 00000100:00100000:2.0:1788793863.514808:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729643136:0@lo:503: 00000100:00100000:2.0:1788793863.514852:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.516524:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d93390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793863.516813:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643136 00000100:00100000:0.0:1788793863.516821:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643136 00000100:00100000:0.0:1788793863.516867:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788793863.516877:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729643136:12345-0@lo:503: 00000100:00100000:0.0:1788793863.517053:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729643136:12345-0@lo:503: Request processed in 177us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793863.517061:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788793863.517368:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729643136:0@lo:503: 00000100:00100000:2.0:1788793863.517572:0:7986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7986:1875685729643264:0@lo:502: 00000100:00100000:2.0:1788793863.517612:0:7986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.517633:0:7986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9339e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793863.520431:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643264 00000100:00100000:0.0:1788793863.520446:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643264 00000100:00100000:0.0:1788793863.520510:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788793863.520520:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:7986:x1875685729643264:12345-0@lo:502: 00000100:00100000:2.0:1788793863.520836:0:7986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7986:1875685729643264:0@lo:502: 00000020:01000000:2.0:1788793863.520874:0:7986:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788793863.520882:0:7986:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788793863.520889:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793863.520891:0:7986:0:(obd_config.c:1547:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788793863.520897:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788793863.520901:0:7986:0:(obd_config.c:1471:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:2.0:1788793863.520922:0:7986:0:(obd_config.c:1958:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788793863.520925:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793863.520940:0:7986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9af4c482cdb8) 00000020:00000080:2.0:1788793863.520959:0:7986:0:(obd_config.c:716:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788793863.520965:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788793863.521060:0:7986:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788793863.521065:0:7986:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788793863.521072:0:7986:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a90c 00010000:00080000:2.0:1788793863.521107:0:7986:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af4fe4e5000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1788793863.521423:0:7986:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000100:00100000:0.0:1788793863.522870:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:7986:x1875685729643264:12345-0@lo:502: Request processed in 2344us (5249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793863.522882:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000040:01000000:0.0:1788793863.534233:0:7986:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788793863.538273:0:7986:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788793863.540947:0:7986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788793863.541528:0:7986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788793863.541622:0:7986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788793863.541733:0:7986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788793863.542471:0:7987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788793863.542476:0:7987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788793863.543451:0:7986:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788793863.543463:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788793863.543581:0:7986:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788793863.543602:0:7986:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x962a5e377b33a913 00000100:00080000:2.0:1788793863.543613:0:7986:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793863.543624:0:7986:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9af4fe4e5000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1788793863.543659:0:7986:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af4ce61d500 x1875685729643392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788793863.543727:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1875685729643392:0@lo:8: 00000100:00100000:1.0:1788793863.543795:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793863.543900:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643392 00000100:00100000:3.0:1788793863.543907:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643392 00000100:00100000:3.0:1788793863.543947:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793863.543954:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3460:x1875685729643392:12345-0@lo:8: 00010000:00080000:3.0:1788793863.543977:0:7516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:3.0:1788793863.544007:0:7516:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x962a5e377b33a91a 00002000:00100000:3.0:1788793863.544036:0:7516:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9af4fa82d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788793863.544040:0:7516:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788793863.544044:0:7516:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788793863.544152:0:7516:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788793863.544377:0:7516:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788793863.544400:0:7516:0:(import.c:65:import_set_state_nolock()) ffff9af4fa829000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788793863.547286:0:7986:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788793863.547434:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788793863.547514:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729643520:0@lo:400: 00000100:00100000:2.0:1788793863.547598:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.547642:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729643648:0@lo:400: 00000100:00100000:2.0:1788793863.547672:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788793863.547769:0:7986:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793863.547777:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793863.547779:0:7986:0:(obd_config.c:1547:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788793863.547783:0:7986:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793863.547787:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793863.547789:0:7986:0:(obd_config.c:1547:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788793863.547792:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793863.547793:0:7986:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788793863.547819:0:7986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7986:1875685729643776:0@lo:502: 00000100:00100000:2.0:1788793863.547862:0:7986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.547891:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643776 00000100:00100000:2.0:1788793863.547898:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643776 00000100:00100000:2.0:1788793863.547940:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788793863.547949:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:7986:x1875685729643776:12345-0@lo:502: 00000100:00100000:2.0:1788793863.548064:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:7986:x1875685729643776:12345-0@lo:502: Request processed in 115us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793863.548072:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788793863.548147:0:7986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9339240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793863.548167:0:7986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:7986:1875685729643776:0@lo:502: 00000020:01000000:2.0:1788793863.548195:0:7986:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793863.548199:0:7986:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793863.548200:0:7986:0:(obd_config.c:1547:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788793863.548203:0:7986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788793863.548575:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788793863.548600:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788793863.548609:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.548621:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793863.548631:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788793863.548634:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af4ce6799e8 from 1 10000000:01000000:2.0:1788793863.548636:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788793863.548661:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.548670:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.548680:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793863.548850:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729643904:0@lo:101: 00000100:00100000:2.0:1788793863.548884:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.548945:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9339240 going to sleep for 11 seconds 00000100:00100000:1.0:1788793863.549153:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643520 00000100:00100000:1.0:1788793863.549159:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643520 00000100:00100000:1.0:1788793863.549192:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643648 00000100:00100000:1.0:1788793863.549195:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643648 00000100:00100000:1.0:1788793863.549223:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793863.549232:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729643520:12345-0@lo:400: 00000100:00100000:1.0:1788793863.549280:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729643520:12345-0@lo:400: Request processed in 50us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.549287:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793863.549310:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788793863.549317:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729643648:12345-0@lo:400: 00000100:00100000:1.0:1788793863.549349:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729643648:12345-0@lo:400: Request processed in 33us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.549354:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788793863.549373:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788793863.549394:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4ce61e680 x1875685729643520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.549418:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729643520:0@lo:400: 00010000:00080000:1.0:1788793863.549443:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4ce61e300 x1875685729643648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.549452:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729643648:0@lo:400: 00000100:00100000:0.0:1788793863.549659:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729643904 00000100:00100000:0.0:1788793863.549663:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729643904 00000100:00100000:0.0:1788793863.549704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788793863.549712:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729643904:12345-0@lo:101: 00010000:00010000:0.0:1788793863.549721:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793863.549735:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a921 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793863.549760:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a921 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793863.549770:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a921 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793863.549778:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c0030e00, rc 0) 00000100:00100000:0.0:1788793863.549806:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729643904:12345-0@lo:101: Request processed in 96us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793863.549811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788793863.549937:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729643904:0@lo:101: 00010000:00010000:2.0:1788793863.549951:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.549959:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793863.550420:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729644032:0@lo:501: 00000100:00100000:2.0:1788793863.550460:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793863.550500:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9339240 going to sleep for 11 seconds 00000100:00100000:0.0:1788793863.550618:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644032 00000100:00100000:0.0:1788793863.550623:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644032 00000100:00100000:0.0:1788793863.550657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788793863.550664:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729644032:12345-0@lo:501: 00000100:00100000:0.0:1788793863.550747:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729644032:12345-0@lo:501: Request processed in 83us (286us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788793863.550754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788793863.550989:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729644032:0@lo:501: 10000000:01000000:2.0:1788793863.551016:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788793863.551025:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793863.551034:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793863.552839:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3460:x1875685729643392:12345-0@lo:8: Request processed in 8873us (9033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793863.552853:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788793863.554018:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4ce61d500 x1875685729643392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788793873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.554034:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788793863.554044:0:3460:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788793863.554053:0:3460:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788793863.554060:0:3460:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788793863.554063:0:3460:0:(import.c:65:import_set_state_nolock()) ffff9af4fe4e5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788793863.554084:0:3460:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788793863.554090:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1875685729643392:0@lo:8: 00000004:00080000:3.0:1788793863.555877:0:7987:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788793863.555960:0:7987:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671255835243ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788793863.555969:0:7987:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788793863.557470:0:7988:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788793863.557578:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729644160:0@lo:13: 00000100:00100000:1.0:1788793863.557701:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793863.557853:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644160 00000100:00100000:3.0:1788793863.557863:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644160 00000100:00100000:3.0:1788793863.557938:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793863.557947:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1875685729644160:12345-0@lo:13: 00002000:00000024:3.0:1788793863.557987:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788793863.558036:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3462:x1875685729644160:12345-0@lo:13: Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793863.558043:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793863.558210:0:7988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644288:0@lo:7: 00000100:00100000:0.0:1788793863.558257:0:7988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793863.558290:0:7988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9db1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788793863.559016:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644288 00000100:00100000:3.0:1788793863.559023:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644288 00000100:00100000:3.0:1788793863.559062:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788793863.559070:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7988:x1875685729644288:12345-0@lo:7: 00000100:00080000:1.0:1788793863.559764:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788793863.559807:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aad180 x1875685729644160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.559829:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729644160:0@lo:13: 00000004:00080000:2.0:1788793863.560636:0:6507:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788793863.565497:0:7519:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788793863.565507:0:7519:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788793863.565596:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7988:x1875685729644288:12345-0@lo:7: Request processed in 6522us (7334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793863.565610:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788793863.565893:0:7988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aaea00 x1875685729644288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788793879 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793863.565909:0:7988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644288:0@lo:7: 00000004:00080000:0.0:1788793863.565922:0:7988:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788793863.565959:0:7988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644416:0@lo:5: 00000100:00100000:0.0:1788793863.565992:0:7988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793863.566033:0:7988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f9db1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788793863.566322:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644416 00000100:00100000:3.0:1788793863.566329:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644416 00000100:00100000:3.0:1788793863.566377:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788793863.566386:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7988:x1875685729644416:12345-0@lo:5: 00002000:00080000:3.0:1788793863.566410:0:7516:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788793863.566414:0:7516:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788793863.580397:0:7512:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788793863.580416:0:7512:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788793863.580779:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7988:x1875685729644416:12345-0@lo:5: Request processed in 14390us (14782us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788793863.580789:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788793863.580887:0:7988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aaea00 x1875685729644416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793879 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.580899:0:7988:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788793863.580904:0:7988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644416:0@lo:5: 00000004:00080000:1.0:1788793863.580931:0:7988:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788793863.580978:0:7988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644544:0@lo:700: 00000100:00100000:1.0:1788793863.581011:0:7988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793863.581054:0:7988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788793863.581236:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644544 00000100:00100000:3.0:1788793863.581243:0:7525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644544 00000100:00100000:3.0:1788793863.581288:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793863.581296:0:7525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7988:x1875685729644544:12345-0@lo:700: 00000100:00100000:3.0:1788793863.581344:0:7525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:7525:1875685729644672:0@lo:700: 00000100:00100000:3.0:1788793863.581375:0:7525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793863.581433:0:7525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d871c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788793863.581928:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644672 00000100:00100000:2.0:1788793863.581934:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644672 00000100:00100000:2.0:1788793863.581972:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788793863.581981:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:7525:x1875685729644672:12345-0@lo:700: 40000000:02000000:3.0:1788793863.587670:0:6536:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00010000:00080000:1.0:1788793863.591824:0:7525:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4c4084380 x1875685729644672/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788793879 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.591843:0:7525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:7525:1875685729644672:0@lo:700: 40000000:02000000:1.0:1788793863.591855:0:7525:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788793863.592609:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:7525:x1875685729644672:12345-0@lo:700: Request processed in 10625us (11229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793863.592645:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788793863.609167:0:7525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7988:x1875685729644544:12345-0@lo:700: Request processed in 27829us (28112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793863.609184:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788793863.609473:0:7988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4c4810700 x1875685729644544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788793879 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793863.609489:0:7988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644544:0@lo:700: 00000004:02000040:1.0:1788793863.614510:0:7988:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788793863.619311:0:7988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644800:0@lo:5: 00000100:00100000:1.0:1788793863.619381:0:7988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793863.619637:0:7988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793863.619762:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644800 00000100:00100000:2.0:1788793863.619770:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644800 00000100:00100000:2.0:1788793863.619860:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793863.619870:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7988:x1875685729644800:12345-0@lo:5: 00002000:00080000:3.0:1788793863.634676:0:7519:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788793863.634769:0:7519:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788793863.638462:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7988:x1875685729644800:12345-0@lo:5: Request processed in 18586us (19073us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788793863.638483:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788793863.638619:0:7988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4c4810e00 x1875685729644800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793879 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793863.638635:0:7988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7988:1875685729644800:0@lo:5: 00000004:00080000:1.0:1788793863.638649:0:7988:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:00080000:1.0:1788793864.267448:0:7512:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788793864.523324:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788793865.342028:0:8038:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788793865.342492:0:8038:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788793865.549369:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788793866.431537:0:8086:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788793866.431554:0:8086:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788793866.571224:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793867.595428:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793868.621455:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793868.623075:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788793868.623098:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729644928:0@lo:13: 00000100:00100000:2.0:1788793868.623243:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793868.623976:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729645312:0@lo:400: 00000100:00100000:0.0:1788793868.624020:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793868.624064:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788793868.624070:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729645184:0@lo:400: 00000100:00100000:0.0:1788793868.624091:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793868.624121:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645312 00000100:00100000:0.0:1788793868.624142:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645312 00000100:00100000:0.0:1788793868.624194:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645184 00000100:00100000:0.0:1788793868.624215:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645184 00000100:00100000:0.0:1788793868.624234:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793868.624243:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729645312:12345-0@lo:400: 00000100:00100000:0.0:1788793868.624314:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729645312:12345-0@lo:400: Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793868.624322:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793868.624340:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788793868.624346:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729645184:12345-0@lo:400: 00000100:00100000:0.0:1788793868.624372:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729645184:12345-0@lo:400: Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793868.624377:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788793868.624397:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788793868.624423:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aaea00 x1875685729645184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793868.624436:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729645184:0@lo:400: 00010000:00080000:0.0:1788793868.624445:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aad180 x1875685729645312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793868.624453:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729645312:0@lo:400: 00000100:00100000:2.0:1788793868.624785:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729645056:0@lo:400: 00000100:00100000:2.0:1788793868.624819:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793868.624933:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645056 00000100:00100000:0.0:1788793868.624938:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645056 00000100:00100000:0.0:1788793868.624978:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788793868.624997:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3464:x1875685729645056:12345-0@lo:400: 00000100:00100000:0.0:1788793868.625035:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3464:x1875685729645056:12345-0@lo:400: Request processed in 41us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793868.625041:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788793868.625668:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729645056:0@lo:400: 00000100:00100000:2.0:1788793868.626771:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729644928 00000100:00100000:2.0:1788793868.626780:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729644928 00000100:00100000:2.0:1788793868.626843:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793868.626852:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729644928:12345-0@lo:13: 00002000:00000024:2.0:1788793868.626879:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788793868.626944:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729644928:12345-0@lo:13: Request processed in 92us (3701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793868.626950:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788793868.626991:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4ce61d880 x1875685729644928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793868.627002:0:3464:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788793868.627027:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729644928:0@lo:13: 00000100:00080000:1.0:1788793868.627077:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788793869.645449:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793870.667320:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793871.694413:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793872.715362:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793873.740633:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729645824:0@lo:400: 00000100:00100000:0.0:1788793873.740726:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793873.740793:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788793873.740809:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729645696:0@lo:400: 00000100:00100000:0.0:1788793873.740838:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793873.740883:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645824 00000100:00100000:0.0:1788793873.740894:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645824 00000100:00100000:0.0:1788793873.740959:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793873.740969:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729645824:12345-0@lo:400: 00000100:00100000:0.0:1788793873.741043:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729645824:12345-0@lo:400: Request processed in 75us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793873.741051:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793873.741082:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645696 00000100:00100000:0.0:1788793873.741085:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645696 00000100:00100000:0.0:1788793873.741159:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788793873.741168:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729645696:12345-0@lo:400: 00000100:00100000:0.0:1788793873.741202:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729645696:12345-0@lo:400: Request processed in 36us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793873.741208:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788793873.741226:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788793873.741232:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788793873.741317:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aac380 x1875685729645696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793873.741334:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729645696:0@lo:400: 00010000:00080000:0.0:1788793873.741346:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aae680 x1875685729645824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793873.741354:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729645824:0@lo:400: 00000100:00100000:2.0:1788793873.741962:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729645568:0@lo:400: 00000100:00100000:2.0:1788793873.742015:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793873.742046:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788793873.742053:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729645440:0@lo:400: 00000100:00100000:2.0:1788793873.742084:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793873.742177:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645568 00000100:00100000:2.0:1788793873.742182:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645568 00000100:00100000:2.0:1788793873.742217:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788793873.742226:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729645568:12345-0@lo:400: 00000100:00100000:2.0:1788793873.742272:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729645568:12345-0@lo:400: Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793873.742278:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788793873.742315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645440 00000100:00100000:2.0:1788793873.742319:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645440 00000100:00100000:2.0:1788793873.742344:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788793873.742351:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3464:x1875685729645440:12345-0@lo:400: 00000100:00100000:2.0:1788793873.742382:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3464:x1875685729645440:12345-0@lo:400: Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793873.742388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788793873.742425:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729645440:0@lo:400: 00010000:00080000:2.0:1788793873.742437:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aaea00 x1875685729645568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793873.742446:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729645568:0@lo:400: 00000100:00100000:3.0:1788793873.743106:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788793873.743209:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729645952:0@lo:13: 00000100:00100000:3.0:1788793873.743262:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793873.747380:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793873.750095:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729645952 00000100:00100000:0.0:1788793873.750145:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729645952 00000100:00100000:1.0:1788793873.750375:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793873.750405:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729645952:12345-0@lo:13: 00002000:00000024:1.0:1788793873.750453:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788793873.750573:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729645952:12345-0@lo:13: Request processed in 171us (7309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793873.750581:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788793873.750688:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aae680 x1875685729645952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793873.750715:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729645952:0@lo:13: 00010000:00010000:0.0:1788793874.765151:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788793875.464017:0:8585:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788793875.464021:0:8585:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788793875.464023:0:8585:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788793875.464213:0:8585:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9af4fa80f000 00000020:01000004:0.0:1788793875.464230:0:8585:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788793875.464243:0:8585:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788793875.464258:0:8585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9af4ce67cdb8) 00000020:00000080:0.0:1788793875.464274:0:8585:0:(obd_config.c:716:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788793875.513859:0:8585:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788793875.513912:0:8585:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788793875.553876:0:8585:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788793875.554100:0:8585:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788793875.554113:0:8585:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788793875.554144:0:8585:0:(genops.c:1375:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x962a5e377b33a936 00000020:01000004:2.0:1788793875.554153:0:8585:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788793875.554176:0:8585:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788793875.554180:0:8585:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788793875.554186:0:8585:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788793875.554229:0:8585:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788793875.554234:0:8585:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788793875.581607:0:8585:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788793875.581646:0:8585:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.108@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788793875.581650:0:8585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788793875.581651:0:8585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788793875.581652:0:8585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793875.581653:0:8585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793875.581655:0:8585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793875.581656:0:8585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793875.581658:0:8585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788793875.581659:0:8585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793875.581660:0:8585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793875.581661:0:8585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793875.581663:0:8585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788793875.581666:0:8585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788793875.581668:0:8585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788793875.581669:0:8585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788793875.581670:0:8585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793875.581671:0:8585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793875.581672:0:8585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793875.581673:0:8585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793875.581679:0:8585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788793875.581680:0:8585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793875.581681:0:8585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793875.581681:0:8585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793875.581682:0:8585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788793875.581707:0:8585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788793875.581845:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729646080:0@lo:253: 00000100:00100000:3.0:1788793875.581916:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793875.581964:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9339cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793875.582054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646080 00000100:00100000:2.0:1788793875.582063:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646080 00000100:00100000:2.0:1788793875.582152:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788793875.582162:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:8585:x1875685729646080:12345-0@lo:253: 20000000:01000000:2.0:1788793875.582267:0:6523:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788793875.582272:0:6523:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788793875.582277:0:6523:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788793875.582280:0:6523:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788793875.582604:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793875.582806:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788793875.582821:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788793875.582838:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788793875.582845:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788793875.582856:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788793875.582870:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788793875.582949:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788793875.582963:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1788793875.582965:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1788793875.582977:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788793875.582982:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788793875.582997:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788793875.583004:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1788793875.583031:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788793875.583040:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788793875.583055:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788793875.583072:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788793875.585312:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788793875.585342:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:2.0:1788793875.585344:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:2.0:1788793875.585377:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788793875.585384:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788793875.585398:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788793875.585403:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:2.0:1788793875.585416:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788793875.585425:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788793875.585438:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788793875.585454:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788793875.585469:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788793875.585597:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788793875.585601:0:6523:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788793875.585638:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788793875.585640:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788793875.585952:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788793875.586063:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788793875.586093:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788793875.586110:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788793875.586118:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788793875.586120:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788793875.586600:0:8592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788793875.586616:0:8592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788793875.586625:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788793875.586819:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788793875.586838:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788793875.586850:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788793875.586858:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788793875.586861:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788793875.587009:0:8593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788793875.587028:0:8593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788793875.587041:0:8593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788793875.587158:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788793875.587176:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788793875.587189:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788793875.587202:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788793875.587204:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788793875.587636:0:8594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788793875.587655:0:8594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788793875.587661:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788793875.587852:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788793875.587864:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788793875.587872:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788793875.587883:0:6523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788793875.587899:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587912:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a887 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587917:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587928:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8db expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587932:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587936:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a921 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587940:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587969:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a921 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.587979:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a921 expref: 16 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.587989:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646208:0@lo:104: 00000100:00100000:2.0:1788793875.588040:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793875.588096:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.588104:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 16 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.588112:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646336:0@lo:104: 00010000:00010000:2.0:1788793875.588174:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a8db expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793875.588289:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788793875.588307:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.588333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646208 00000100:00100000:1.0:1788793875.588341:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646208 00000100:00100000:1.0:1788793875.588370:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646336 00000100:00100000:1.0:1788793875.588374:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646336 00000100:00100000:1.0:1788793875.588387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793875.588395:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af502059050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:6523:x1875685729646208:12345-0@lo:104: 00010000:00010000:1.0:1788793875.588406:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.588458:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793875.588464:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af502059050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:6523:x1875685729646208:12345-0@lo:104: Request processed in 71us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.588482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793875.588518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788793875.588523:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729646336:12345-0@lo:104: 00010000:00010000:1.0:1788793875.588528:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.588555:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788793875.588560:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729646336:12345-0@lo:104: Request processed in 38us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.588575:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788793875.588576:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788793875.588582:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.588590:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513800 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793875.588594:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.588602:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793875.588615:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793875.588621:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793875.588633:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793875.588649:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.588656:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793875.588682:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.588689:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a928 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.588701:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793875.588703:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793875.588704:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793875.588786:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729646592:0@lo:103: 00000100:00100000:3.0:1788793875.588850:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.588886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646592 00000100:00100000:0.0:1788793875.588890:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646592 00010000:00010000:0.0:1788793875.588908:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a921 expref: 17 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.588930:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788793875.588937:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:3464:x1875685729646592:12345-0@lo:103: 00010000:00010000:0.0:1788793875.588945:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793875.588950:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a921 expref: 17 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.589022:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a8db expref: 17 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.589033:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646464:0@lo:104: 00010000:00010000:0.0:1788793875.589034:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a921 expref: 17 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.589055:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793875.589056:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793875.589154:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.589163:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 17 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.589171:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646720:0@lo:104: 00000100:00100000:2.0:1788793875.589200:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.589240:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:3464:x1875685729646592:12345-0@lo:103: Request processed in 304us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.589247:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793875.589330:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729646592:0@lo:103: 00010000:00010000:2.0:1788793875.589500:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a887 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.589509:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a887 expref: 16 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.589517:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646848:0@lo:104: 00000100:00100000:2.0:1788793875.589540:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793875.589562:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646464 00000100:00100000:3.0:1788793875.589566:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646464 00000100:00100000:1.0:1788793875.589599:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646720 00000100:00100000:1.0:1788793875.589603:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646720 00000100:00100000:1.0:1788793875.589620:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788793875.589627:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:6523:x1875685729646464:12345-0@lo:104: 00010000:00010000:1.0:1788793875.589636:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.589676:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793875.589681:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:6523:x1875685729646464:12345-0@lo:104: Request processed in 55us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.589687:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788793875.589702:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788793875.589722:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729646720:12345-0@lo:104: 00010000:00010000:1.0:1788793875.589730:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.589756:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788793875.589761:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729646720:12345-0@lo:104: Request processed in 41us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.589766:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788793875.590016:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4dadff540 going to sleep for 11 seconds 00010000:00010000:2.0:1788793875.590029:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c0030e00/0x962a5e377b33a928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a921 expref: 16 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.590043:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646208:0@lo:104: 00000100:00100000:2.0:1788793875.590052:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646336:0@lo:104: 00000100:00100000:2.0:1788793875.590059:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646464:0@lo:104: 00000100:00100000:2.0:1788793875.590076:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646720:0@lo:104: 00000100:00100000:3.0:1788793875.590324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646848 00000100:00100000:3.0:1788793875.590328:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646848 00000100:00100000:3.0:1788793875.590347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793875.590354:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729646848:12345-0@lo:104: 00010000:00010000:3.0:1788793875.590362:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.590406:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788793875.590411:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6523:x1875685729646848:12345-0@lo:104: Request processed in 58us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.590417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788793875.590531:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6523:1875685729646848:0@lo:104: 00010000:00010000:2.0:1788793875.590555:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.590860:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788793875.590866:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.590873:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c0031a00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793875.590877:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.590884:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793875.590891:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793875.590897:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793875.590931:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.590938:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793875.590964:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.590971:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c0031a00/0x962a5e377b33a8db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.590983:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788793875.590996:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591001:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513e00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793875.591004:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591011:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793875.591017:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.591019:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729646976:0@lo:103: 10000000:01000000:0.0:1788793875.591022:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793875.591044:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591050:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788793875.591054:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793875.591055:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591062:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33a8b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8b8 expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591070:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793875.591074:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591079:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d1e00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793875.591082:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.591093:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793875.591099:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729647104:0@lo:103: 00010000:00010000:0.0:1788793875.591108:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793875.591115:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.591118:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788793875.591120:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793875.591149:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591155:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793875.591170:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.591174:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788793875.591177:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1e00/0x962a5e377b33a887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a88e expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.591182:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729647232:0@lo:103: 00010000:00010000:0.0:1788793875.591188:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793875.591189:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793875.591191:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793875.591205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729646976 00000100:00100000:0.0:1788793875.591209:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729646976 00010000:00010000:0.0:1788793875.591225:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8db expref: 16 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.591243:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647104 00000100:00100000:0.0:1788793875.591245:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647104 00010000:00010000:0.0:1788793875.591256:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 17 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.591280:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793875.591293:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:3461:x1875685729646976:12345-0@lo:103: 00010000:00010000:0.0:1788793875.591303:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793875.591308:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8db expref: 17 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591318:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a8db expref: 17 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591331:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b800/0x962a5e377b33a8e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a8db expref: 17 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591343:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793875.591343:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.591380:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3461:x1875685729646976:12345-0@lo:103: Request processed in 88us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.591387:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788793875.591400:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729646976:0@lo:103: 00000100:00100000:0.0:1788793875.591406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647232 00000100:00100000:0.0:1788793875.591409:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647232 00010000:00010000:0.0:1788793875.591420:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a887 expref: 16 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.591434:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793875.591439:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3461:x1875685729647104:12345-0@lo:103: 00010000:00010000:0.0:1788793875.591460:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793875.591465:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 16 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591473:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 16 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591483:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33a8b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a8b1 expref: 16 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591497:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793875.591531:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:3461:x1875685729647104:12345-0@lo:103: Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.591538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793875.591551:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788793875.591557:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3464:x1875685729647232:12345-0@lo:103: 00010000:00010000:0.0:1788793875.591564:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788793875.591564:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729647104:0@lo:103: 00010000:00010000:0.0:1788793875.591568:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a887 expref: 14 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591576:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a887 expref: 14 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591586:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166a800/0x962a5e377b33a88e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a887 expref: 14 pid: 6524 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.591595:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793875.591628:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3464:x1875685729647232:12345-0@lo:103: Request processed in 71us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.591634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788793875.591655:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729647232:0@lo:103: 00010000:00010000:1.0:1788793875.591910:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793875.591913:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793875.591914:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793875.591939:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.591947:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513600 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793875.591950:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.591957:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793875.591963:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793875.591969:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793875.592023:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592029:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788793875.592075:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788793875.592099:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592106:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33a8f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592120:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793875.592139:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793875.592141:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793875.592326:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729647360:0@lo:103: 00000100:00100000:1.0:1788793875.592371:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793875.592447:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647360 00000100:00100000:3.0:1788793875.592456:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647360 00010000:00010000:3.0:1788793875.592553:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 13 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.592583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793875.592591:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3463:x1875685729647360:12345-0@lo:103: 00010000:00010000:3.0:1788793875.592599:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793875.592604:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 13 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592614:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 13 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592625:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a8fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a8f7 expref: 13 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592637:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592646:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592660:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592667:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592675:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592681:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592692:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1512200 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:3.0:1788793875.592697:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592837:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592857:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.592869:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793875.592903:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3463:x1875685729647360:12345-0@lo:103: Request processed in 313us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.592910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788793875.592989:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729647360:0@lo:103: 00010000:00010000:2.0:1788793875.593053:0:6523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.593061:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.593068:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a93d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788793875.593080:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788793875.598447:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:8585:x1875685729646080:12345-0@lo:253: Request processed in 16278us (16523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793875.598461:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788793875.598695:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729646080:0@lo:253: 10000000:01000000:3.0:1788793875.598864:0:8585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788793875.598868:0:8585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788793875.598869:0:8585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788793875.598871:0:8585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793875.598872:0:8585:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788793875.598873:0:8585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793875.598874:0:8585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793875.598876:0:8585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788793875.598877:0:8585:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788793875.598879:0:8585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793875.598880:0:8585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788793875.598898:0:8585:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9af4fa80f000 from lustre-OST0001 10000000:01000000:3.0:1788793875.598926:0:8585:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788793875.598928:0:8585:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788793875.598935:0:8585:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9af4ce6799e8 local copy 10000000:01000000:3.0:1788793875.598938:0:8585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788793875.598980:0:8585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.598989:0:8585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.598997:0:8585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793875.599012:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729647488:0@lo:101: 00000100:00100000:3.0:1788793875.599043:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793875.599117:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d93399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793875.599308:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647488 00000100:00100000:2.0:1788793875.599315:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647488 00000100:00100000:2.0:1788793875.599390:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788793875.599400:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:8585:x1875685729647488:12345-0@lo:101: 00010000:00010000:2.0:1788793875.599412:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793875.599426:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512c00/0x962a5e377b33a94b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a944 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.599456:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512c00/0x962a5e377b33a94b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a944 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.599467:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512c00/0x962a5e377b33a94b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a944 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.599488:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512c00, rc 0) 00000100:00100000:2.0:1788793875.599534:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729647488:12345-0@lo:101: Request processed in 136us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793875.599540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788793875.599603:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729647488:0@lo:101: 00010000:00010000:0.0:1788793875.599616:0:8585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.599625:0:8585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.599706:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729647616:0@lo:501: 00000100:00100000:0.0:1788793875.599739:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.599767:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793875.599950:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647616 00000100:00100000:2.0:1788793875.599955:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647616 00000100:00100000:2.0:1788793875.600016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788793875.600023:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729647616:12345-0@lo:501: 00000100:00100000:2.0:1788793875.600102:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729647616:12345-0@lo:501: Request processed in 79us (362us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788793875.600109:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788793875.600149:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729647616:0@lo:501: 10000000:01000000:0.0:1788793875.600173:0:8585:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788793875.600190:0:8585:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788793875.600196:0:8585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.600204:0:8585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.600211:0:8585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.600235:0:8585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788793875.600262:0:8585:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9af4fa80f000 10000000:01000000:0.0:1788793875.600267:0:8585:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788793875.600272:0:8585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788793875.600275:0:8585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788793875.600279:0:8585:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:1.0:1788793875.600280:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1788793875.600281:0:8585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788793875.600286:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.600293:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d0a00 already unused, calling callback (ffffffffc14dac20) 00010000:00010000:0.0:1788793875.600297:0:8585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793875.600297:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.600305:0:8585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.600306:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.600313:0:8585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793875.600314:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793875.600320:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788793875.600335:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729647744:0@lo:101: 00010000:00010000:1.0:1788793875.600336:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.600341:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793875.600358:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.600360:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793875.600365:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0a00/0x962a5e377b33a944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x962a5e377b33a94b expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.600381:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793875.600383:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793875.600384:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793875.600399:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788793875.600410:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729647872:0@lo:103: 00000100:00100000:1.0:1788793875.600439:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.600491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647872 00000100:00100000:1.0:1788793875.600495:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647872 00000100:00100000:1.0:1788793875.600526:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788793875.600533:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3462:x1875685729647872:12345-0@lo:103: 00010000:00010000:1.0:1788793875.600543:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793875.600554:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1512c00/0x962a5e377b33a94b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x962a5e377b33a944 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.600567:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793875.600595:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:3462:x1875685729647872:12345-0@lo:103: Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.600602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788793875.600627:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729647872:0@lo:103: 00000100:00100000:3.0:1788793875.600899:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729647744 00000100:00100000:0.0:1788793875.600901:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.600904:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729647744 00000100:00100000:3.0:1788793875.600932:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788793875.600939:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+11:8585:x1875685729647744:12345-0@lo:101: 00010000:00010000:3.0:1788793875.600947:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793875.600959:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a952 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.600977:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a952 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.600986:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a952 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.600993:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0e00, rc 0) 00000100:00100000:3.0:1788793875.601035:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729647744:12345-0@lo:101: Request processed in 97us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.601042:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788793875.601302:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729647744:0@lo:101: 00010000:00010000:0.0:1788793875.601317:0:8585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.601326:0:8585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.601397:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648000:0@lo:501: 00000100:00100000:0.0:1788793875.601424:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.601448:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.601549:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648000 00000100:00100000:3.0:1788793875.601554:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648000 00000100:00100000:3.0:1788793875.601573:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788793875.601579:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648000:12345-0@lo:501: 00000100:00100000:3.0:1788793875.601681:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648000:12345-0@lo:501: Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.601688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788793875.601945:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648000:0@lo:501: 00000100:00100000:0.0:1788793875.601981:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648128:0@lo:503: 00000100:00100000:0.0:1788793875.602024:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.602048:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.602099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648128 00000100:00100000:3.0:1788793875.602104:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648128 00000100:00100000:3.0:1788793875.602339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788793875.602348:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648128:12345-0@lo:503: 00000100:00100000:3.0:1788793875.602433:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648128:12345-0@lo:503: Request processed in 86us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.602439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788793875.602575:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648128:0@lo:503: 00000040:00080000:0.0:1788793875.602898:0:8585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788793875.602959:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648256:0@lo:502: 00000100:00100000:0.0:1788793875.602997:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.603099:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788793875.603554:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648256 00000100:00100000:2.0:1788793875.603559:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648256 00000100:00100000:1.0:1788793875.603644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788793875.603654:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648256:12345-0@lo:502: 00000100:00100000:1.0:1788793875.603791:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648256:12345-0@lo:502: Request processed in 139us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.603798:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788793875.603905:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648256:0@lo:502: 00000040:00080000:0.0:1788793875.604099:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788793875.604356:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788793875.604376:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788793875.604387:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788793875.604398:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788793875.604409:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788793875.604440:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648384:0@lo:502: 00000100:00100000:1.0:1788793875.604618:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.604655:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4ce7cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.604694:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648384 00000100:00100000:3.0:1788793875.604699:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648384 00000100:00100000:3.0:1788793875.604781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788793875.604788:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648384:12345-0@lo:502: 00000100:00100000:3.0:1788793875.604864:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648384:12345-0@lo:502: Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.604870:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788793875.604932:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648384:0@lo:502: 00000040:00080000:1.0:1788793875.604966:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788793875.604973:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788793875.605454:0:8596:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788793875.605461:0:8596:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788793875.605467:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793875.605532:0:8596:0:(obd_config.c:1547:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788793875.605540:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788793875.605554:0:8596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9af4ce678000) 00000020:00000080:0.0:1788793875.605572:0:8596:0:(obd_config.c:716:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788793875.605577:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788793875.605885:0:8596:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af4fa80f000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788793875.605892:0:8596:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788793875.605899:0:8596:0:(genops.c:1375:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x962a5e377b33a967 00010000:00010000:1.0:1788793875.611809:0:8596:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788793875.612108:0:8596:0:(tgt_lastrcvd.c:1869:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788793875.615357:0:8596:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788793875.615840:0:8596:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788793875.618915:0:8596:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788793875.619030:0:8596:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788793875.623351:0:8596:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788793875.624764:0:8596:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788793875.624776:0:8596:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793875.624783:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793875.624785:0:8596:0:(obd_config.c:1547:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788793875.624788:0:8596:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793875.624793:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793875.624794:0:8596:0:(obd_config.c:1547:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788793875.624796:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793875.624799:0:8596:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788793875.624820:0:8596:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793875.624829:0:8596:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793875.624831:0:8596:0:(obd_config.c:1547:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788793875.624835:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788793875.625047:0:8585:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788793875.625097:0:8585:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788793875.625119:0:8585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.625155:0:8585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793875.625163:0:8585:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af4fa80f000 from 1 10000000:01000000:1.0:1788793875.625166:0:8585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788793875.625210:0:8585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.625219:0:8585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.625230:0:8585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793875.625265:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648512:0@lo:101: 00000100:00100000:1.0:1788793875.625338:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.625379:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d0e11600 going to sleep for 11 seconds 00000100:00100000:2.0:1788793875.625982:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648512 00000100:00100000:2.0:1788793875.625990:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648512 00000100:00100000:2.0:1788793875.626046:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788793875.626056:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:8585:x1875685729648512:12345-0@lo:101: 00010000:00010000:2.0:1788793875.626070:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793875.626096:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a96e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.626141:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a96e expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.626154:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a96e expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.626163:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512200, rc 0) 00000100:00100000:2.0:1788793875.626227:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648512:12345-0@lo:101: Request processed in 171us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793875.626233:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788793875.626282:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648512:0@lo:101: 00010000:00010000:2.0:1788793875.626298:0:8585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793875.626308:0:8585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793875.626405:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648640:0@lo:501: 00000100:00100000:2.0:1788793875.626447:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793875.626464:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.627159:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648640 00000100:00100000:3.0:1788793875.627168:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648640 00000100:00100000:3.0:1788793875.627349:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788793875.627358:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648640:12345-0@lo:501: 00000100:00100000:3.0:1788793875.627609:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648640:12345-0@lo:501: Request processed in 251us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.627629:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788793875.631665:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648640:0@lo:501: 00000100:00100000:1.0:1788793875.631820:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648768:0@lo:503: 00000100:00100000:1.0:1788793875.631898:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.631945:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d0e110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.632028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648768 00000100:00100000:3.0:1788793875.632035:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648768 00000100:00100000:3.0:1788793875.632103:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788793875.632113:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648768:12345-0@lo:503: 00000100:00100000:3.0:1788793875.632285:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648768:12345-0@lo:503: Request processed in 173us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.632293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788793875.632465:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648768:0@lo:503: 00000040:00080000:1.0:1788793875.632855:0:8585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788793875.632922:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648896:0@lo:502: 00000100:00100000:1.0:1788793875.632962:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.632995:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d0e110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793875.633015:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729648896 00000100:00100000:1.0:1788793875.633019:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729648896 00000100:00100000:1.0:1788793875.633050:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788793875.633057:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648896:12345-0@lo:502: 00000100:00100000:1.0:1788793875.633172:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729648896:12345-0@lo:502: Request processed in 114us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.633179:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788793875.633234:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729648896:0@lo:502: 00000040:00080000:1.0:1788793875.633421:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788793875.633446:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788793875.633468:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649024:0@lo:502: 00000100:00100000:1.0:1788793875.633889:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.633915:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d3f3c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788793875.633935:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649024 00000100:00100000:1.0:1788793875.633940:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649024 00000100:00100000:1.0:1788793875.633968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788793875.633975:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729649024:12345-0@lo:502: 00000100:00100000:1.0:1788793875.634051:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729649024:12345-0@lo:502: Request processed in 76us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.634058:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788793875.634114:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649024:0@lo:502: 00000040:00080000:1.0:1788793875.634180:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788793875.634200:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788793875.635341:0:8600:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793875.635352:0:8600:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793875.635354:0:8600:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788793875.635360:0:8600:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af4fa80f000 00000020:00000080:1.0:1788793875.635363:0:8600:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788793875.635373:0:8600:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793875.635376:0:8600:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793875.635377:0:8600:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788793875.635379:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788793875.635612:0:8585:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788793875.635638:0:8585:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788793875.635658:0:8585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.635670:0:8585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793875.635789:0:8585:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788793875.635793:0:8585:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9af4fa80f000 10000000:01000000:0.0:1788793875.635796:0:8585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9af4fa80f000 10000000:01000000:0.0:1788793875.635800:0:8585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788793875.635805:0:8585:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4fa80f000 from 1 10000000:01000000:0.0:1788793875.635808:0:8585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788793875.635839:0:8585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.635848:0:8585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.635858:0:8585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.635887:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649152:0@lo:101: 00000100:00100000:0.0:1788793875.635937:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.635969:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793875.636643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649152 00000100:00100000:1.0:1788793875.636650:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649152 00000100:00100000:1.0:1788793875.637345:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788793875.637363:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:8585:x1875685729649152:12345-0@lo:101: 00010000:00010000:1.0:1788793875.637379:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793875.637396:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a97c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.637422:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a97c expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.637447:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a97c expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.637455:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166b400, rc 0) 00000100:00100000:1.0:1788793875.638404:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649152:12345-0@lo:101: Request processed in 1042us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.638413:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788793875.638814:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649152:0@lo:101: 00010000:00010000:0.0:1788793875.638839:0:8585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793875.638850:0:8585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.638963:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649280:0@lo:501: 00000100:00100000:0.0:1788793875.639000:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.639046:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793875.639064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649280 00000100:00100000:0.0:1788793875.639070:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649280 00000100:00100000:0.0:1788793875.639163:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788793875.639173:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649280:12345-0@lo:501: 00000100:00100000:0.0:1788793875.640235:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649280:12345-0@lo:501: Request processed in 1061us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.640245:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788793875.640448:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649280:0@lo:501: 00000100:00100000:1.0:1788793875.640571:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649408:0@lo:503: 00000100:00100000:1.0:1788793875.640623:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.640661:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d3f3c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793875.640779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649408 00000100:00100000:0.0:1788793875.640785:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649408 00000100:00100000:0.0:1788793875.640828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788793875.640837:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649408:12345-0@lo:503: 00000100:00100000:0.0:1788793875.640931:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649408:12345-0@lo:503: Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.640947:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788793875.641048:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649408:0@lo:503: 00000040:00080000:1.0:1788793875.641326:0:8585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788793875.641385:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649536:0@lo:502: 00000100:00100000:1.0:1788793875.641426:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.641444:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d879e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788793875.641662:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649536 00000100:00100000:0.0:1788793875.641667:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649536 00000100:00100000:0.0:1788793875.641703:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788793875.641781:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649536:12345-0@lo:502: 00000100:00100000:0.0:1788793875.641940:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649536:12345-0@lo:502: Request processed in 230us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.641948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788793875.644018:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649536:0@lo:502: 00000040:00080000:2.0:1788793875.645049:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788793875.645101:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788793875.645120:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788793875.645162:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788793875.645176:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788793875.645199:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788793875.645215:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788793875.645228:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788793875.645241:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788793875.645253:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788793875.645266:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788793875.645279:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788793875.645292:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788793875.645304:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788793875.645317:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788793875.645330:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788793875.645344:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788793875.645358:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788793875.645372:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788793875.645398:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788793875.645414:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788793875.645427:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788793875.645441:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788793875.645454:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788793875.645468:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788793875.645780:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788793875.645803:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788793875.645819:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788793875.645846:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788793875.645859:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788793875.645872:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788793875.645884:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788793875.645895:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788793875.645907:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788793875.645936:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788793875.645951:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788793875.645965:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788793875.646009:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649664:0@lo:502: 00000100:00100000:2.0:1788793875.646097:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793875.646166:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.646697:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649664 00000100:00100000:3.0:1788793875.646707:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649664 00000100:00100000:3.0:1788793875.646774:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788793875.646784:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649664:12345-0@lo:502: 00000100:00100000:3.0:1788793875.646920:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729649664:12345-0@lo:502: Request processed in 138us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.646928:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788793875.647775:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729649664:0@lo:502: 00000040:00080000:2.0:1788793875.647854:0:8585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788793875.647867:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788793875.649572:0:8601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788793875.649601:0:8601:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9af4f762cdb8) 00000020:00000080:2.0:1788793875.649622:0:8601:0:(obd_config.c:716:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788793875.649685:0:8601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9af4fa80f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788793875.649688:0:8601:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9af4fa80f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788793875.649690:0:8601:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9af4fa80f000 3 00010000:00080000:2.0:1788793875.649720:0:8601:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af4f7336800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1788793875.653553:0:8601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788793875.653802:0:8601:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788793875.653844:0:8601:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788793875.653857:0:8601:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x962a5e377b33a991 00000100:00080000:2.0:1788793875.653868:0:8601:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793875.653878:0:8601:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9af4f7336800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1788793875.653912:0:8601:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af4ce61f800 x1875685729649792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788793875.653955:0:8601:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1788793875.654172:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788793875.654208:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729649920:0@lo:400: 00000100:00100000:0.0:1788793875.654269:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788793875.654294:0:8602:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9af4ce61df80 x1875685729650304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793875.654303:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c6089f00 going to sleep for 0 seconds 00000100:00100000:0.0:1788793875.654310:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1875685729650048:0@lo:400: 00000100:00100000:0.0:1788793875.654331:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.654352:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788793875.654358:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729650176:0@lo:400: 00000100:00100000:0.0:1788793875.654383:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.654436:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649920 00000100:00100000:0.0:1788793875.654443:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649920 00000100:00100000:0.0:1788793875.654502:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650048 00000100:00100000:0.0:1788793875.654506:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650048 00000100:00100000:0.0:1788793875.654531:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788793875.654538:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729649920:12345-0@lo:400: 00000100:00100000:0.0:1788793875.654584:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729649920:12345-0@lo:400: Request processed in 46us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.654591:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788793875.654605:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788793875.654611:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1875685729650048:12345-0@lo:400: 00000100:00100000:0.0:1788793875.654654:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1875685729650048:12345-0@lo:400: Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.654660:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788793875.654680:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650176 00000100:00100000:0.0:1788793875.654684:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650176 00000100:00100000:0.0:1788793875.654708:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793875.654713:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729650176:12345-0@lo:400: 00000100:00100000:0.0:1788793875.654741:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729650176:12345-0@lo:400: Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.654747:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788793875.654765:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788793875.654769:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788793875.654793:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aafb80 x1875685729650176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793875.654806:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729650176:0@lo:400: 00010000:00080000:0.0:1788793875.654817:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aac000 x1875685729650048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793875.654825:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1875685729650048:0@lo:400: 00010000:00080000:0.0:1788793875.654865:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af501aadc00 x1875685729649920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793875.654874:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729649920:0@lo:400: 00000100:00100000:3.0:1788793875.655953:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3460:1875685729649792:0@lo:38: 00000100:00100000:3.0:1788793875.656005:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793875.656255:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729649792 00000100:00100000:2.0:1788793875.656261:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729649792 00000100:00100000:2.0:1788793875.656303:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793875.656310:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3460:x1875685729649792:12345-0@lo:38: 00010000:00080000:2.0:1788793875.656333:0:6530:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:2.0:1788793875.656364:0:6530:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x962a5e377b33a998 00000004:00100000:2.0:1788793875.656378:0:6530:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788793875.656407:0:6530:0:(import.c:65:import_set_state_nolock()) ffff9af4f7331800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788793875.656454:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1875685729649792:12345-0@lo:38: Request processed in 144us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793875.656461:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788793875.656534:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4ce61f800 x1875685729649792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788793885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793875.656543:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788793875.656550:0:3460:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788793875.656557:0:3460:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788793875.656561:0:3460:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788793875.656563:0:3460:0:(import.c:65:import_set_state_nolock()) ffff9af4f7336800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788793875.656568:0:3460:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000051c404de): req@ffff9af4ce61df80 x1875685729650304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793875.656596:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3460:1875685729649792:0@lo:38: 00000100:00100000:3.0:1788793875.657350:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793875.657385:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650304 00000100:00100000:3.0:1788793875.657390:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650304 00000100:00100000:3.0:1788793875.657457:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793875.657463:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8602:x1875685729650304:12345-0@lo:901: 00000100:00100000:3.0:1788793875.657634:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8602:x1875685729650304:12345-0@lo:901: Request processed in 170us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.657640:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788793875.657666:0:8602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9af4ce61df80 x1875685729650304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788793891 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793875.657676:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61df80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8602:1875685729650304:0@lo:901: 00000020:01000000:1.0:1788793875.658450:0:8585:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788793875.658550:0:8585:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793875.658605:0:8585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.658618:0:8585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788793875.658653:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1788793875.658664:0:8585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788793875.658666:0:8585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788793875.658672:0:8585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793875.658673:0:8585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793875.658674:0:8585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793875.658676:0:8585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793875.658677:0:8585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788793875.658679:0:8585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793875.658680:0:8585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793875.658681:0:8585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793875.658682:0:8585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788793875.658686:0:8585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788793875.658688:0:8585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788793875.658689:0:8585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788793875.658690:0:8585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793875.658691:0:8585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793875.658692:0:8585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793875.658693:0:8585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793875.658694:0:8585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788793875.658695:0:8585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793875.658696:0:8585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793875.658697:0:8585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793875.658698:0:8585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788793875.658729:0:8585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788793875.658742:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729650432:0@lo:253: 00000100:00100000:1.0:1788793875.658785:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.658819:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788793875.658857:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650432 00000100:00100000:0.0:1788793875.658862:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650432 00000100:00100000:0.0:1788793875.658924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788793875.658931:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729650432:12345-0@lo:253: 20000000:01000000:0.0:1788793875.658955:0:6524:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788793875.658964:0:6524:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788793875.664465:0:6524:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788793875.664491:0:6524:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788793875.664670:0:6545:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788793875.664676:0:6545:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788793875.664697:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.664726:0:6545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.664735:0:6545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.664773:0:6545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.664798:0:6545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793875.664814:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6545:1875685729650560:0@lo:104: 00000100:00100000:1.0:1788793875.664878:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793875.664919:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5c0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788793875.665017:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650560 00000100:00100000:3.0:1788793875.665024:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650560 00000100:00100000:3.0:1788793875.665077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788793875.665099:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6545:x1875685729650560:12345-0@lo:104: 00010000:00010000:3.0:1788793875.665112:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.665202:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793875.665208:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:6545:x1875685729650560:12345-0@lo:104: Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793875.665215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788793875.665279:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6545:1875685729650560:0@lo:104: 00010000:00010000:0.0:1788793875.665298:0:6545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.665385:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793875.665392:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.665400:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d1a00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793875.665403:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.665411:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793875.665418:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793875.665424:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793875.665457:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.665463:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793875.665492:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.665500:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a8e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793875.665520:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729650688:0@lo:103: 00010000:00010000:1.0:1788793875.665525:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793875.665527:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793875.665528:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793875.665553:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793875.665734:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8585:x1875685729650432:12345-0@lo:253: Request processed in 6803us (6947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793875.665743:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788793875.665794:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8585:1875685729650432:0@lo:253: 10000000:01000000:2.0:1788793875.665804:0:8585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788793875.665806:0:8585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788793875.665807:0:8585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788793875.665808:0:8585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793875.665809:0:8585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788793875.665810:0:8585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793875.665811:0:8585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793875.665812:0:8585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793875.665813:0:8585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788793875.665814:0:8585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788793875.665820:0:8585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793875.665821:0:8585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788793875.665830:0:8585:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788793875.666418:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650688 00000100:00100000:1.0:1788793875.666425:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650688 00010000:00010000:1.0:1788793875.666447:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793875.666527:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788793875.666536:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3461:x1875685729650688:12345-0@lo:103: 00010000:00010000:1.0:1788793875.666548:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793875.666553:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666563:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666577:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166a400/0x962a5e377b33a8f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a8e9 expref: 14 pid: 6522 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666590:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666597:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788793875.666610:0:6513:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004712060s 00010000:00010000:1.0:1788793875.666614:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666632:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666639:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666645:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666651:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166b000 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:1.0:1788793875.666655:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666663:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666684:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793875.666693:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793875.666733:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3461:x1875685729650688:12345-0@lo:103: Request processed in 199us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793875.666740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788793875.666851:0:6545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.666868:0:6545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793875.666875:0:6545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b000/0x962a5e377b33a99f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788793875.670026:0:8585:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788793875.670415:0:8585:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788793875.670633:0:8585:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:0.0:1788793875.670642:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729650688:0@lo:103: 00080000:10000000:2.0:1788793875.670897:0:8585:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788793875.671166:0:8585:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788793875.671374:0:8585:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788793875.673453:0:8585:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788793875.681924:0:8585:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788793875.681936:0:8585:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788793875.681995:0:8585:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788793875.682044:0:8585:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788793875.682062:0:8585:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788793875.682099:0:8585:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788793875.684901:0:8585:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788793875.685179:0:8585:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788793875.792435:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788793876.599929:0:8655:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788793876.601571:0:8655:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788793876.821476:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793877.836279:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793878.859838:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793878.859872:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793878.859910:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729650816:0@lo:13: 00000100:00100000:3.0:1788793878.860004:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793878.860749:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650816 00000100:00100000:0.0:1788793878.860764:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650816 00000100:00100000:0.0:1788793878.860860:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788793878.860873:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729650816:12345-0@lo:13: 00002000:00000024:0.0:1788793878.860907:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793878.861005:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729650816:12345-0@lo:13: Request processed in 135us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793878.861013:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788793878.861108:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793878.861157:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aadc00 x1875685729650816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793878.861185:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729650816:0@lo:13: 00010000:00010000:1.0:1788793879.885692:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793880.907373:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729650944:0@lo:400: 00000100:00100000:0.0:1788793880.907459:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793880.907508:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1875685729651456:0@lo:400: 00000100:00100000:0.0:1788793880.907539:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793880.907567:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788793880.907582:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729651072:0@lo:400: 00000100:00100000:0.0:1788793880.907606:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793880.907635:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729651200:0@lo:400: 00000100:00100000:0.0:1788793880.907659:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793880.907676:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788793880.907680:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729651328:0@lo:400: 00000100:00100000:0.0:1788793880.907703:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793880.907728:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793880.907742:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729650944 00000100:00100000:0.0:1788793880.907748:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729650944 00000100:00100000:0.0:1788793880.907788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788793880.907797:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3463:x1875685729650944:12345-0@lo:400: 00000100:00100000:0.0:1788793880.907844:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3463:x1875685729650944:12345-0@lo:400: Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793880.907851:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788793880.907882:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651456 00000100:00100000:0.0:1788793880.907886:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651456 00000100:00100000:0.0:1788793880.907912:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651072 00000100:00100000:0.0:1788793880.907915:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651072 00000100:00100000:0.0:1788793880.907927:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651200 00000100:00100000:0.0:1788793880.907929:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651200 00000100:00100000:0.0:1788793880.907943:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788793880.907949:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1875685729651456:12345-0@lo:400: 00000100:00100000:0.0:1788793880.907979:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1875685729651456:12345-0@lo:400: Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793880.907986:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788793880.908011:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788793880.908017:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729651072:12345-0@lo:400: 00000100:00100000:0.0:1788793880.908052:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729651072:12345-0@lo:400: Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793880.908057:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788793880.908069:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788793880.908075:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729651200:12345-0@lo:400: 00000100:00100000:0.0:1788793880.908104:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729651200:12345-0@lo:400: Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793880.908109:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788793880.908154:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651328 00000100:00100000:0.0:1788793880.908157:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651328 00000100:00100000:0.0:1788793880.908184:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788793880.908190:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729651328:12345-0@lo:400: 00000100:00100000:0.0:1788793880.908218:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729651328:12345-0@lo:400: Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793880.908223:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788793880.908237:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788793880.908241:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788793880.908268:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aace00 x1875685729651328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793880.908281:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729651328:0@lo:400: 00010000:00080000:0.0:1788793880.908290:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aad180 x1875685729651200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793880.908298:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729651200:0@lo:400: 00010000:00080000:0.0:1788793880.908323:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aafb80 x1875685729651072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793880.908342:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729651072:0@lo:400: 00000100:00100000:0.0:1788793880.908351:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729650944:0@lo:400: 00010000:00080000:0.0:1788793880.908360:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aadc00 x1875685729651456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793880.908367:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1875685729651456:0@lo:400: 00000001:02000400:2.0:1788793881.702346:0:8945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788793881.937110:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788793881.939400:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788793881.939408:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af501bb0000 from 30 10000000:01000000:1.0:1788793881.939414:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788793881.939465:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793881.939478:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793881.939489:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793881.939514:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729651584:0@lo:101: 00000100:00100000:1.0:1788793881.939581:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793881.939636:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.939952:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651584 00000100:00100000:3.0:1788793881.939961:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651584 00000100:00100000:3.0:1788793881.940031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788793881.940040:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729651584:12345-0@lo:101: 00010000:00010000:3.0:1788793881.940054:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793881.940067:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a9a6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.940092:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.940104:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.940113:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d1c00, rc 0) 00000100:00100000:3.0:1788793881.940211:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729651584:12345-0@lo:101: Request processed in 172us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.940218:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788793881.940258:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729651584:0@lo:101: 00010000:00010000:3.0:1788793881.940272:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.940280:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793881.940351:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729651712:0@lo:501: 00000100:00100000:3.0:1788793881.940376:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.940388:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793881.940466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651712 00000100:00100000:1.0:1788793881.940471:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651712 00000100:00100000:1.0:1788793881.940494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788793881.940500:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729651712:12345-0@lo:501: 00000100:00100000:1.0:1788793881.940611:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729651712:12345-0@lo:501: Request processed in 110us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793881.940616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788793881.940863:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729651712:0@lo:501: 00000100:00100000:3.0:1788793881.940888:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729651840:0@lo:503: 00000100:00100000:3.0:1788793881.940923:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.940950:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.940963:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651840 00000100:00100000:3.0:1788793881.940966:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651840 00000100:00100000:3.0:1788793881.941001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788793881.941007:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729651840:12345-0@lo:503: 00000100:00100000:3.0:1788793881.941075:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729651840:12345-0@lo:503: Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.941081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788793881.941115:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729651840:0@lo:503: 00000100:00100000:3.0:1788793881.941509:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8957:1875685729651968:0@lo:502: 00000100:00100000:3.0:1788793881.941547:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.941575:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.941619:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729651968 00000100:00100000:2.0:1788793881.941623:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729651968 00000100:00100000:2.0:1788793881.941665:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788793881.941674:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8957:x1875685729651968:12345-0@lo:502: 00000100:00100000:2.0:1788793881.941765:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8957:x1875685729651968:12345-0@lo:502: Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.941771:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788793881.941838:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4084380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8957:1875685729651968:0@lo:502: 00000100:00100000:1.0:1788793881.941879:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8957:1875685729652096:0@lo:502: 00000100:00100000:1.0:1788793881.941911:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793881.941935:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.942015:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652096 00000100:00100000:2.0:1788793881.942019:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652096 00000100:00100000:2.0:1788793881.942049:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788793881.942063:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8957:x1875685729652096:12345-0@lo:502: 00000100:00100000:2.0:1788793881.942116:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:8957:x1875685729652096:12345-0@lo:502: Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.942147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788793881.942222:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8957:1875685729652096:0@lo:502: 00000040:00080000:1.0:1788793881.942241:0:8957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788793881.942369:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788793881.942389:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788793881.942397:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.942408:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793881.942419:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788793881.942421:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788793881.942424:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788793881.942450:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.942457:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.942466:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793881.942477:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652224:0@lo:101: 00000100:00100000:2.0:1788793881.942504:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.942533:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f77379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793881.942572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652224 00000100:00100000:1.0:1788793881.942576:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652224 00000100:00100000:1.0:1788793881.942608:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788793881.942623:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729652224:12345-0@lo:101: 00010000:00010000:1.0:1788793881.942631:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793881.942643:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a9b4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793881.942664:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793881.942675:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793881.942683:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a000, rc 0) 00000100:00100000:1.0:1788793881.942710:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729652224:12345-0@lo:101: Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793881.942715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788793881.944797:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652224:0@lo:101: 00010000:00010000:2.0:1788793881.944824:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.944845:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793881.944921:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652352:0@lo:501: 00000100:00100000:2.0:1788793881.944982:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.945029:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f77379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.945171:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652352 00000100:00100000:3.0:1788793881.945178:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652352 00000100:00100000:3.0:1788793881.945219:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788793881.945237:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729652352:12345-0@lo:501: 00000100:00100000:3.0:1788793881.945486:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729652352:12345-0@lo:501: Request processed in 259us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.945494:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788793881.945543:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652352:0@lo:501: 00000100:00100000:3.0:1788793881.945569:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652480:0@lo:503: 00000100:00100000:3.0:1788793881.945609:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.945632:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.945646:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652480 00000100:00100000:3.0:1788793881.945649:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652480 00000100:00100000:3.0:1788793881.945673:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788793881.945681:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729652480:12345-0@lo:503: 00000100:00100000:3.0:1788793881.945760:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729652480:12345-0@lo:503: Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.945767:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788793881.945808:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652480:0@lo:503: 00000100:00100000:3.0:1788793881.946673:0:8958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8958:1875685729652608:0@lo:502: 00000100:00100000:3.0:1788793881.946720:0:8958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.946787:0:8958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.951644:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652608 00000100:00100000:2.0:1788793881.951658:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652608 00000100:00100000:2.0:1788793881.951727:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788793881.951739:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:8958:x1875685729652608:12345-0@lo:502: 00000100:00100000:2.0:1788793881.951910:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:8958:x1875685729652608:12345-0@lo:502: Request processed in 174us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.951920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788793881.951936:0:8958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8958:1875685729652608:0@lo:502: 00000020:01000000:3.0:1788793881.951994:0:8958:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788793881.952003:0:8958:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793881.952005:0:8958:0:(obd_config.c:1547:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788793881.952009:0:8958:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788793881.952011:0:8958:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788793881.952036:0:8958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8958:1875685729652736:0@lo:502: 00000100:00100000:3.0:1788793881.952075:0:8958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.952110:0:8958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.952793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652736 00000100:00100000:2.0:1788793881.952800:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652736 00000100:00100000:2.0:1788793881.952836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788793881.952845:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:8958:x1875685729652736:12345-0@lo:502: 00000100:00100000:2.0:1788793881.952933:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:8958:x1875685729652736:12345-0@lo:502: Request processed in 90us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.952941:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788793881.956182:0:8958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8958:1875685729652736:0@lo:502: 00000020:01000000:3.0:1788793881.956228:0:8958:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788793881.956236:0:8958:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793881.956238:0:8958:0:(obd_config.c:1547:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788793881.956243:0:8958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788793881.956313:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788793881.956343:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788793881.956353:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.956365:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793881.956375:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788793881.956378:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4dfc78000 from 30 10000000:01000000:3.0:1788793881.956380:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788793881.956411:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.956420:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.956439:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793881.956471:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652864:0@lo:101: 00000100:00100000:3.0:1788793881.956542:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.956573:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.956944:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652864 00000100:00100000:2.0:1788793881.956952:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652864 00000100:00100000:2.0:1788793881.957018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788793881.957028:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729652864:12345-0@lo:101: 00010000:00010000:2.0:1788793881.957041:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793881.957053:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a9c2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.957083:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.957094:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.957103:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512400, rc 0) 00000100:00100000:2.0:1788793881.957167:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729652864:12345-0@lo:101: Request processed in 141us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.957175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788793881.957212:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652864:0@lo:101: 00010000:00010000:2.0:1788793881.957226:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.957235:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793881.957289:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652992:0@lo:501: 00000100:00100000:2.0:1788793881.957314:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.957330:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f77379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.957342:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729652992 00000100:00100000:2.0:1788793881.957346:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729652992 00000100:00100000:2.0:1788793881.957371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788793881.957380:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729652992:12345-0@lo:501: 00000100:00100000:2.0:1788793881.957500:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729652992:12345-0@lo:501: Request processed in 121us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.957506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788793881.957545:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729652992:0@lo:501: 00000100:00100000:2.0:1788793881.957569:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653120:0@lo:503: 00000100:00100000:2.0:1788793881.957603:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.957615:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f77379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.957627:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653120 00000100:00100000:2.0:1788793881.957630:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653120 00000100:00100000:2.0:1788793881.957654:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788793881.957662:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729653120:12345-0@lo:503: 00000100:00100000:2.0:1788793881.957732:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729653120:12345-0@lo:503: Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.957739:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788793881.957777:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653120:0@lo:503: 00000100:00100000:2.0:1788793881.958062:0:8960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8960:1875685729653248:0@lo:502: 00000100:00100000:2.0:1788793881.958094:0:8960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.958151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653248 00000100:00100000:2.0:1788793881.958155:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653248 00000100:00100000:2.0:1788793881.958180:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788793881.958188:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:8960:x1875685729653248:12345-0@lo:502: 00000100:00100000:2.0:1788793881.958255:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:8960:x1875685729653248:12345-0@lo:502: Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.958261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788793881.958289:0:8960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737840 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.958301:0:8960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8960:1875685729653248:0@lo:502: 00000100:00100000:2.0:1788793881.958341:0:8960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8960:1875685729653376:0@lo:502: 00000100:00100000:2.0:1788793881.958373:0:8960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.958767:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653376 00000100:00100000:2.0:1788793881.958773:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653376 00000100:00100000:2.0:1788793881.958867:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788793881.958876:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:8960:x1875685729653376:12345-0@lo:502: 00000100:00100000:2.0:1788793881.958941:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:8960:x1875685729653376:12345-0@lo:502: Request processed in 67us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.958948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788793881.959172:0:8960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737840 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.959187:0:8960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8960:1875685729653376:0@lo:502: 00000040:00080000:2.0:1788793881.959210:0:8960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788793881.959284:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788793881.959301:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788793881.959310:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.959321:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793881.959332:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788793881.959334:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9af4dfc78000 from 5 10000000:01000000:2.0:1788793881.959337:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788793881.959359:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.959367:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793881.959376:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793881.959400:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653504:0@lo:101: 00000100:00100000:2.0:1788793881.959428:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.959441:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737840 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.959638:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653504 00000100:00100000:3.0:1788793881.959643:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653504 00000100:00100000:3.0:1788793881.959676:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788793881.959684:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729653504:12345-0@lo:101: 00010000:00010000:3.0:1788793881.959693:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793881.959706:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0a00/0x962a5e377b33a9d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a9d0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.959727:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0a00/0x962a5e377b33a9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a9d0 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.959739:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0a00/0x962a5e377b33a9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9d0 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.959748:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0a00, rc 0) 00000100:00100000:3.0:1788793881.959783:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729653504:12345-0@lo:101: Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.959802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788793881.959834:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653504:0@lo:101: 00010000:00010000:3.0:1788793881.959846:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9d7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.959865:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a9d7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793881.959902:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653632:0@lo:256: 00000100:00100000:3.0:1788793881.959931:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.959946:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.959957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653632 00000100:00100000:3.0:1788793881.960092:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653632 00000100:00100000:3.0:1788793881.960111:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788793881.960116:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729653632:12345-0@lo:256: 20000000:01000000:3.0:1788793881.960147:0:6522:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788793881.960164:0:6522:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788793881.960168:0:6522:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788793881.960240:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729653632:12345-0@lo:256: Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.960246:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788793881.960275:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653632:0@lo:256: 10000000:01000000:3.0:1788793881.960312:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788793881.960318:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9d7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960325:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513800/0x962a5e377b33a9d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9d7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793881.960331:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788793881.960333:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788793881.960335:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788793881.960354:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960360:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960368:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793881.960379:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653760:0@lo:101: 00000100:00100000:3.0:1788793881.960400:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.960412:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.960422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653760 00000100:00100000:3.0:1788793881.960425:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653760 00000100:00100000:3.0:1788793881.960444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788793881.960450:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729653760:12345-0@lo:101: 00010000:00010000:3.0:1788793881.960457:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793881.960464:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33a9de expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960478:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33a9de expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960487:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9de expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960494:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d1e00, rc 0) 00000100:00100000:3.0:1788793881.960519:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729653760:12345-0@lo:101: Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.960524:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788793881.960558:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653760:0@lo:101: 00010000:00010000:3.0:1788793881.960568:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793881.960576:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793881.960620:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653888:0@lo:501: 00000100:00100000:3.0:1788793881.960645:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.960658:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793881.960669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729653888 00000100:00100000:3.0:1788793881.960672:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729653888 00000100:00100000:3.0:1788793881.960691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788793881.960696:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729653888:12345-0@lo:501: 00000100:00100000:3.0:1788793881.963090:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729653888:12345-0@lo:501: Request processed in 2380us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.963106:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788793881.963338:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729653888:0@lo:501: 00000100:00100000:3.0:1788793881.963393:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729654016:0@lo:503: 00000100:00100000:3.0:1788793881.963455:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793881.963598:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.970450:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654016 00000100:00100000:2.0:1788793881.970465:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654016 00000100:00100000:3.0:1788793881.970652:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788793881.970664:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729654016:12345-0@lo:503: 00000100:00100000:3.0:1788793881.972553:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729654016:12345-0@lo:503: Request processed in 1883us (9088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793881.972567:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788793881.972631:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729654016:0@lo:503: 00000100:00100000:2.0:1788793881.975197:0:8963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8963:1875685729654144:0@lo:502: 00000100:00100000:2.0:1788793881.975276:0:8963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793881.975314:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654144 00000100:00100000:2.0:1788793881.975321:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654144 00000100:00100000:2.0:1788793881.975379:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788793881.975390:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:8963:x1875685729654144:12345-0@lo:502: 00000100:00100000:2.0:1788793881.975504:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:8963:x1875685729654144:12345-0@lo:502: Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793881.975512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788793881.975564:0:8963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737600 going to sleep for 11 seconds 00000100:00100000:2.0:1788793881.975586:0:8963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8963:1875685729654144:0@lo:502: 00000020:01000000:2.0:1788793881.975616:0:8963:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788793881.975623:0:8963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788793881.975629:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793881.975632:0:8963:0:(obd_config.c:1547:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788793881.975638:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788793881.975642:0:8963:0:(obd_config.c:1471:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:2.0:1788793881.975667:0:8963:0:(obd_config.c:1958:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788793881.975670:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793881.975685:0:8963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9af4f7628000) 00000020:00000080:2.0:1788793881.975707:0:8963:0:(obd_config.c:716:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788793881.975719:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788793881.975778:0:8963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788793881.975783:0:8963:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788793881.975813:0:8963:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x962a5e377b33a9f3 00010000:00080000:2.0:1788793881.975842:0:8963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9af4fe562800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1788793881.976105:0:8963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788793881.976262:0:8963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788793881.976274:0:8963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788793881.976447:0:8963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793881.976579:0:8963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793881.976687:0:8963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788793881.976784:0:8963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788793881.977671:0:8964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788793881.977677:0:8964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788793882.007582:0:8963:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788793882.007597:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788793882.007644:0:8963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788793882.007667:0:8963:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x962a5e377b33a9fa 00000100:00080000:2.0:1788793882.007679:0:8963:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793882.007690:0:8963:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9af4fe562800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1788793882.007726:0:8963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9af4ce61f100 x1875685729654272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788793882.007755:0:8963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788793882.007934:0:8963:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793882.007939:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793882.007941:0:8963:0:(obd_config.c:1547:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788793882.007945:0:8963:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793882.007949:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793882.007951:0:8963:0:(obd_config.c:1547:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788793882.007954:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793882.007955:0:8963:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788793882.008067:0:8963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8963:1875685729654400:0@lo:502: 00000100:00100000:2.0:1788793882.008319:0:8963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793882.008363:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654400 00000100:00100000:2.0:1788793882.008371:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654400 00000100:00100000:2.0:1788793882.008413:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788793882.008426:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:8963:x1875685729654400:12345-0@lo:502: 00000100:00100000:2.0:1788793882.008552:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:8963:x1875685729654400:12345-0@lo:502: Request processed in 129us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793882.008562:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788793882.008620:0:8963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793882.008641:0:8963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:8963:1875685729654400:0@lo:502: 00000020:01000000:2.0:1788793882.008665:0:8963:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793882.008669:0:8963:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793882.008671:0:8963:0:(obd_config.c:1547:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788793882.008674:0:8963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788793882.008746:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788793882.008770:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788793882.008781:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.011907:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793882.011922:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788793882.011925:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af4ce6799e8 from 1 10000000:01000000:2.0:1788793882.011929:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1788793882.012630:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1875685729654272:0@lo:8: 00000100:00100000:0.0:1788793882.012717:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793882.012815:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654272 00000100:00100000:0.0:1788793882.012826:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654272 00000100:00100000:0.0:1788793882.012867:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788793882.012876:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3460:x1875685729654272:12345-0@lo:8: 00010000:00080000:0.0:1788793882.012910:0:7517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1788793882.012940:0:7517:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x962a5e377b33aa01 00002000:00100000:0.0:1788793882.012953:0:7517:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9af4f9df1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788793882.012962:0:7517:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00010000:00010000:2.0:1788793882.013017:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013026:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013057:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793882.013076:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729654528:0@lo:101: 00000100:00100000:2.0:1788793882.013135:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793882.013154:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793882.013171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654528 00000100:00100000:2.0:1788793882.013176:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654528 00000100:00100000:2.0:1788793882.013219:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788793882.013226:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729654528:12345-0@lo:101: 00010000:00010000:2.0:1788793882.013238:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793882.013250:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aa08 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013270:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013281:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013290:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1513e00, rc 0) 00000100:00100000:2.0:1788793882.013328:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729654528:12345-0@lo:101: Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793882.013333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788793882.013379:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729654528:0@lo:101: 00010000:00010000:2.0:1788793882.013393:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013411:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793882.013479:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729654656:0@lo:501: 00000100:00100000:2.0:1788793882.013504:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793882.013518:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f7737240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793882.013531:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654656 00000100:00100000:2.0:1788793882.013534:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654656 00000100:00100000:2.0:1788793882.013559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788793882.013567:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729654656:12345-0@lo:501: 00000100:00100000:2.0:1788793882.013638:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729654656:12345-0@lo:501: Request processed in 72us (133us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788793882.013645:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788793882.013674:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729654656:0@lo:501: 10000000:01000000:2.0:1788793882.013699:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788793882.013705:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793882.013713:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793882.015800:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729654784:0@lo:400: 00000100:00100000:3.0:1788793882.015865:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793882.015902:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788793882.015909:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729655168:0@lo:400: 00000100:00100000:3.0:1788793882.015932:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793882.015981:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729654912:0@lo:400: 00000100:00100000:3.0:1788793882.016005:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793882.016024:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793882.016029:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729655040:0@lo:400: 00000100:00100000:3.0:1788793882.016053:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793882.016351:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654784 00000100:00100000:3.0:1788793882.016361:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654784 00000100:00100000:3.0:1788793882.016411:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655168 00000100:00100000:3.0:1788793882.016415:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655168 00000100:00100000:3.0:1788793882.016441:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729654912 00000100:00100000:3.0:1788793882.016444:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729654912 00000100:00100000:3.0:1788793882.016461:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793882.016469:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729654784:12345-0@lo:400: 00000100:00100000:3.0:1788793882.016526:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729654784:12345-0@lo:400: Request processed in 58us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793882.016533:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793882.016549:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788793882.016555:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729655168:12345-0@lo:400: 00000100:00100000:3.0:1788793882.016580:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729655168:12345-0@lo:400: Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793882.016586:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788793882.016613:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788793882.016619:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729654912:12345-0@lo:400: 00000100:00100000:3.0:1788793882.016651:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729654912:12345-0@lo:400: Request processed in 32us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793882.016656:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788793882.016683:0:7516:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788793882.016692:0:7516:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1788793882.016722:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788793882.016756:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4085c00 x1875685729655168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793882.016773:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729655168:0@lo:400: 00010000:00080000:3.0:1788793882.016785:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4086680 x1875685729654784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793882.016794:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729654784:0@lo:400: 00010000:00080000:3.0:1788793882.016825:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4086d80 x1875685729654912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793882.016834:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729654912:0@lo:400: 00000001:00000004:0.0:1788793882.017424:0:7517:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788793882.017504:0:7517:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788793882.017741:0:7517:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788793882.017772:0:7517:0:(import.c:65:import_set_state_nolock()) ffff9af4f9df5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788793882.017834:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3460:x1875685729654272:12345-0@lo:8: Request processed in 4958us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793882.017842:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788793882.017861:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655040 00000100:00100000:0.0:1788793882.017873:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655040 00000100:00100000:0.0:1788793882.017912:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788793882.017919:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729655040:12345-0@lo:400: 00000100:00100000:0.0:1788793882.017986:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729655040:12345-0@lo:400: Request processed in 67us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793882.017992:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788793882.018029:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce61f100 x1875685729654272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788793892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793882.018040:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788793882.018048:0:3460:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788793882.018056:0:3460:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788793882.018062:0:3460:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788793882.018064:0:3460:0:(import.c:65:import_set_state_nolock()) ffff9af4fe562800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788793882.018071:0:3460:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788793882.018076:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3460:1875685729654272:0@lo:8: 00000100:00080000:0.0:1788793882.018096:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788793882.020542:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4085500 x1875685729655040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793882.020561:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729655040:0@lo:400: 00000004:00080000:1.0:1788793882.021008:0:8964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788793882.030686:0:8964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689730557320ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788793882.030703:0:8964:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788793882.032541:0:8965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788793882.032578:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655424:0@lo:7: 00000100:00100000:1.0:1788793882.032655:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793882.032700:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788793882.032780:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729655296:0@lo:13: 00000100:00100000:0.0:1788793882.032813:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793882.032855:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655424 00000100:00100000:0.0:1788793882.032862:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655424 00000100:00100000:0.0:1788793882.032916:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793882.032925:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8965:x1875685729655424:12345-0@lo:7: 00000004:00080000:1.0:1788793882.037167:0:6507:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:1.0:1788793882.038383:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788793882.038402:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655296 00000100:00100000:1.0:1788793882.038412:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655296 00000100:00100000:1.0:1788793882.038473:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793882.038483:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3464:x1875685729655296:12345-0@lo:13: 00002000:00000024:1.0:1788793882.038513:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923816448 avail 3692294144 00000100:00100000:1.0:1788793882.038598:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3464:x1875685729655296:12345-0@lo:13: Request processed in 117us (5785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793882.038605:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:0.0:1788793882.047902:0:7517:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788793882.047912:0:7517:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788793882.049121:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8965:x1875685729655424:12345-0@lo:7: Request processed in 16182us (16451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793882.049149:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788793882.049213:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4810700 x1875685729655296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793882.049237:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729655296:0@lo:13: 00010000:00080000:1.0:1788793882.050017:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4813b80 x1875685729655424/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788793898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793882.050030:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655424:0@lo:7: 00000004:00080000:1.0:1788793882.050042:0:8965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788793882.050083:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655552:0@lo:5: 00000100:00100000:1.0:1788793882.050150:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793882.050191:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788793882.051309:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655552 00000100:00100000:3.0:1788793882.051320:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655552 00000100:00100000:3.0:1788793882.051375:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793882.051384:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8965:x1875685729655552:12345-0@lo:5: 00002000:00080000:3.0:1788793882.051413:0:7516:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788793882.051417:0:7516:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788793882.074157:0:8587:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788793882.074173:0:8587:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788793882.074286:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8965:x1875685729655552:12345-0@lo:5: Request processed in 22898us (24131us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788793882.074296:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788793882.074347:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4813b80 x1875685729655552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793882.074373:0:8965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788793882.074379:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655552:0@lo:5: 00000004:00080000:0.0:1788793882.074393:0:8965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788793882.074445:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655680:0@lo:700: 00000100:00100000:0.0:1788793882.074476:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793882.074508:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788793882.074528:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655680 00000100:00100000:0.0:1788793882.074533:0:7525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655680 00000100:00100000:0.0:1788793882.074572:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793882.074580:0:7525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8965:x1875685729655680:12345-0@lo:700: 00000100:00100000:0.0:1788793882.074616:0:7525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:7525:1875685729655808:0@lo:700: 00000100:00100000:0.0:1788793882.074656:0:7525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793882.074675:0:7525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793882.074694:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655808 00000100:00100000:0.0:1788793882.074698:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655808 00000100:00100000:0.0:1788793882.074729:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793882.074735:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7525:x1875685729655808:12345-0@lo:700: 40000000:02000000:2.0:1788793882.090668:0:6536:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788793882.102789:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7525:x1875685729655808:12345-0@lo:700: Request processed in 28044us (28123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793882.102805:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788793882.102978:0:7525:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aace00 x1875685729655808/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788793898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793882.102994:0:7525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:7525:1875685729655808:0@lo:700: 40000000:02000000:0.0:1788793882.103008:0:7525:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788793882.150411:0:7525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8965:x1875685729655680:12345-0@lo:700: Request processed in 75821us (75923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793882.150444:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788793882.150798:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af501aafb80 x1875685729655680/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788793898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793882.150815:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aafb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655680:0@lo:700: 00000004:02000040:3.0:1788793882.160718:0:8965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788793882.166519:0:8965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655936:0@lo:5: 00000100:00100000:3.0:1788793882.166595:0:8965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793882.166719:0:8965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fa99dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788793882.168096:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729655936 00000100:00100000:1.0:1788793882.168512:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729655936 00000100:00100000:0.0:1788793882.168807:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793882.168819:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8965:x1875685729655936:12345-0@lo:5: 00002000:00080000:0.0:1788793882.178822:0:7519:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788793882.178845:0:7519:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788793882.182054:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8965:x1875685729655936:12345-0@lo:5: Request processed in 13230us (15451us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788793882.182070:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788793882.182331:0:8965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4086d80 x1875685729655936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793882.182351:0:8965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8965:1875685729655936:0@lo:5: 00000004:00080000:3.0:1788793882.182427:0:8965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000020:00000004:0.0:1788793882.836781:0:9004:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788793882.837036:0:9004:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788793882.955387:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788793883.883194:0:8587:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788793883.979647:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793883.979699:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729656064:0@lo:13: 00000100:00100000:1.0:1788793883.979765:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793883.979970:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656064 00000100:00100000:0.0:1788793883.979980:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656064 00000100:00100000:0.0:1788793883.980035:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793883.980044:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729656064:12345-0@lo:13: 00002000:00000024:0.0:1788793883.980075:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793883.980159:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729656064:12345-0@lo:13: Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793883.980166:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788793883.980355:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d3800 x1875685729656064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793883.980374:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729656064:0@lo:13: 00010000:00010000:0.0:1788793885.004263:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788793885.969278:0:9106:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788793885.969663:0:9106:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788793886.029368:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788793886.989838:0:9154:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788793886.989848:0:9154:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788793887.052481:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793887.053601:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793887.053624:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729656192:0@lo:13: 00000100:00100000:3.0:1788793887.053687:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793887.053868:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656192 00000100:00100000:0.0:1788793887.053899:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656192 00000100:00100000:0.0:1788793887.053952:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788793887.053960:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729656192:12345-0@lo:13: 00002000:00000024:0.0:1788793887.053989:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793887.054030:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729656192:12345-0@lo:13: Request processed in 70us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793887.054037:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788793887.054058:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788793887.054070:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729656704:0@lo:400: 00000100:00100000:0.0:1788793887.054099:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793887.054143:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788793887.054150:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729656576:0@lo:400: 00000100:00100000:0.0:1788793887.054177:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793887.054204:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656576 00000100:00100000:0.0:1788793887.054208:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656576 00000100:00100000:0.0:1788793887.054238:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788793887.054245:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729656576:12345-0@lo:400: 00000100:00100000:0.0:1788793887.054292:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729656576:12345-0@lo:400: Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793887.054298:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788793887.054315:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788793887.054337:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d1c00 x1875685729656576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793887.054350:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729656576:0@lo:400: 00010000:00080000:0.0:1788793887.054377:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4085c00 x1875685729656192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793887.054384:0:3461:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788793887.054405:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729656192:0@lo:13: 00000100:00100000:2.0:1788793887.054538:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729656448:0@lo:400: 00000100:00100000:2.0:1788793887.054568:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793887.054599:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788793887.054605:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729656320:0@lo:400: 00000100:00100000:2.0:1788793887.054631:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793887.054652:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729656832:0@lo:400: 00000100:00100000:2.0:1788793887.054676:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793887.054701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656320 00000100:00100000:2.0:1788793887.054706:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656320 00000100:00100000:2.0:1788793887.054747:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788793887.054755:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729656320:12345-0@lo:400: 00000100:00100000:2.0:1788793887.054790:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729656320:12345-0@lo:400: Request processed in 36us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793887.054796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788793887.054830:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729656320:0@lo:400: 00000100:00100000:1.0:1788793887.055101:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656704 00000100:00100000:1.0:1788793887.055107:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656704 00000100:00100000:1.0:1788793887.055188:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793887.055196:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729656704:12345-0@lo:400: 00000100:00100000:1.0:1788793887.055237:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729656704:12345-0@lo:400: Request processed in 43us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793887.055244:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788793887.055262:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788793887.055291:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d1500 x1875685729656704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793887.055302:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729656704:0@lo:400: 00000100:00100000:0.0:1788793887.055421:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656448 00000100:00100000:0.0:1788793887.055427:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656448 00000100:00100000:0.0:1788793887.055460:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656832 00000100:00100000:0.0:1788793887.055464:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656832 00000100:00100000:0.0:1788793887.055486:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788793887.055492:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729656448:12345-0@lo:400: 00000100:00100000:0.0:1788793887.055528:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729656448:12345-0@lo:400: Request processed in 36us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793887.055535:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788793887.055547:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788793887.055554:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729656832:12345-0@lo:400: 00000100:00100000:0.0:1788793887.055580:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729656832:12345-0@lo:400: Request processed in 27us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793887.055586:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788793887.055611:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d2680 x1875685729656832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793887.055620:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729656832:0@lo:400: 00010000:00080000:0.0:1788793887.055629:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d1880 x1875685729656448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793887.055637:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729656448:0@lo:400: 00000100:00080000:1.0:1788793887.056559:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788793888.078851:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793889.102039:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793889.102362:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793889.102394:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729656960:0@lo:13: 00000100:00100000:3.0:1788793889.102495:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793889.102667:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729656960 00000100:00100000:0.0:1788793889.102679:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729656960 00000100:00100000:0.0:1788793889.102756:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793889.102767:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729656960:12345-0@lo:13: 00002000:00000024:0.0:1788793889.102826:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793889.102893:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729656960:12345-0@lo:13: Request processed in 128us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793889.102901:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788793889.103269:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d1880 x1875685729656960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793889.103295:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729656960:0@lo:13: 00000100:00080000:1.0:1788793889.104796:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788793890.126710:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793891.150421:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793892.174278:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793892.178756:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729657344:0@lo:400: 00000100:00100000:3.0:1788793892.178864:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793892.178959:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729657856:0@lo:400: 00000100:00100000:3.0:1788793892.178987:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793892.179018:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793892.179030:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1875685729657472:0@lo:400: 00000100:00100000:3.0:1788793892.179050:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793892.179553:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657344 00000100:00100000:1.0:1788793892.179563:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657344 00000100:00100000:1.0:1788793892.179633:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657472 00000100:00100000:1.0:1788793892.179636:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657472 00000100:00100000:1.0:1788793892.179669:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788793892.179679:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729657344:12345-0@lo:400: 00000100:00100000:1.0:1788793892.179752:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729657344:12345-0@lo:400: Request processed in 75us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793892.179760:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788793892.179778:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788793892.179784:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1875685729657472:12345-0@lo:400: 00000100:00100000:1.0:1788793892.179820:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1875685729657472:12345-0@lo:400: Request processed in 37us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793892.179826:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788793892.179842:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788793892.179939:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729657216:0@lo:400: 00000100:00100000:1.0:1788793892.179976:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657856 00000100:00100000:2.0:1788793892.179988:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793892.179989:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657856 00000100:00100000:2.0:1788793892.180030:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1875685729657728:0@lo:400: 00000100:00100000:1.0:1788793892.180036:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788793892.180048:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729657856:12345-0@lo:400: 00000100:00100000:2.0:1788793892.180062:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793892.180088:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788793892.180097:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729657088:0@lo:13: 00000100:00100000:1.0:1788793892.180102:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729657856:12345-0@lo:400: Request processed in 55us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793892.180110:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788793892.180158:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788793892.180172:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793892.180187:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657216 00000100:00100000:1.0:1788793892.180192:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657216 00000100:00100000:2.0:1788793892.180204:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729657600:0@lo:400: 00000100:00100000:1.0:1788793892.180225:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788793892.180233:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3462:x1875685729657216:12345-0@lo:400: 00000100:00100000:2.0:1788793892.180239:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793892.180281:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657600 00000100:00100000:2.0:1788793892.180297:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657600 00000100:00100000:3.0:1788793892.180319:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657728 00000100:00100000:3.0:1788793892.180325:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657728 00000100:00100000:2.0:1788793892.180340:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793892.180359:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788793892.180371:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729657600:12345-0@lo:400: 00000100:00100000:3.0:1788793892.180372:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1875685729657728:12345-0@lo:400: 00000100:00100000:0.0:1788793892.180484:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657088 00000100:00100000:0.0:1788793892.180489:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657088 00000100:00100000:0.0:1788793892.180520:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793892.180528:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729657088:12345-0@lo:13: 00002000:00000024:0.0:1788793892.180555:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788793892.185831:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3462:x1875685729657216:12345-0@lo:400: Request processed in 5580us (5824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793892.185851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788793892.185948:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729657600:12345-0@lo:400: Request processed in 5597us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793892.185961:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788793892.186047:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788793892.186056:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788793892.186454:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1875685729657728:12345-0@lo:400: Request processed in 6085us (6390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793892.186465:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788793892.186532:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4813b80 x1875685729657472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793892.186550:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1875685729657472:0@lo:400: 00010000:00080000:3.0:1788793892.186568:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4810e00 x1875685729657344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793892.186577:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729657344:0@lo:400: 00010000:00080000:3.0:1788793892.186592:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7790a80 x1875685729657856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793892.186600:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729657856:0@lo:400: 00000100:00100000:0.0:1788793892.187453:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729657088:12345-0@lo:13: Request processed in 6920us (7275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793892.187466:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788793892.193405:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4084700 x1875685729657088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793892.193444:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729657088:0@lo:13: 00010000:00080000:2.0:1788793892.193466:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4810700 x1875685729657600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793892.193474:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729657600:0@lo:400: 00000100:00100000:2.0:1788793892.193486:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729657216:0@lo:400: 00010000:00080000:2.0:1788793892.193499:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7793b80 x1875685729657728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793892.193508:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1875685729657728:0@lo:400: 00010000:00010000:0.0:1788793893.198219:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793894.221457:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793894.221568:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729657984:0@lo:13: 00000100:00100000:1.0:1788793894.221676:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793894.222335:0:7521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729657984 00000100:00100000:0.0:1788793894.222348:0:7521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729657984 00000100:00100000:0.0:1788793894.222451:0:7521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788793894.222463:0:7521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729657984:12345-0@lo:13: 00002000:00000024:0.0:1788793894.222507:0:7521:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793894.222913:0:7521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729657984:12345-0@lo:13: Request processed in 451us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793894.222923:0:7521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788793894.223367:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793894.224191:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d2680 x1875685729657984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793894.224222:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729657984:0@lo:13: 00010000:00010000:2.0:1788793895.244160:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793896.268665:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793897.291670:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793897.291904:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1875685729658368:0@lo:400: 00000100:00100000:0.0:1788793897.292004:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793897.292150:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729658112:0@lo:400: 00000100:00100000:3.0:1788793897.292229:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729658240:0@lo:400: 00000100:00100000:3.0:1788793897.292266:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793897.292298:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788793897.292313:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729658624:0@lo:13: 00000100:00100000:3.0:1788793897.292347:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793897.292397:0:7521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658624 00000100:00100000:3.0:1788793897.292407:0:7521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658624 00000100:00100000:3.0:1788793897.292478:0:7521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793897.292488:0:7521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729658624:12345-0@lo:13: 00002000:00000024:3.0:1788793897.292524:0:7521:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788793897.292577:0:7521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729658624:12345-0@lo:13: Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793897.292585:0:7521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788793897.292599:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793897.292620:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658368 00000100:00100000:3.0:1788793897.292626:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658368 00000100:00100000:2.0:1788793897.292664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658112 00000100:00100000:3.0:1788793897.292664:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658240 00000100:00100000:2.0:1788793897.292672:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658112 00000100:00100000:3.0:1788793897.292672:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658240 00000100:00100000:3.0:1788793897.292705:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788793897.292715:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1875685729658368:12345-0@lo:400: 00000100:00100000:2.0:1788793897.292743:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788793897.292764:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729658112:12345-0@lo:400: 00000100:00100000:2.0:1788793897.292807:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729658112:12345-0@lo:400: Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793897.292815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788793897.292868:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729658112:0@lo:400: 00000100:00100000:2.0:1788793897.292888:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788793897.292892:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729658496:0@lo:400: 00000100:00100000:2.0:1788793897.292897:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1875685729658752:0@lo:400: 00000100:00100000:2.0:1788793897.292937:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793897.292944:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793897.292989:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788793897.292999:0:6530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1788793897.293017:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788793897.293023:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788793897.293033:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658496 00000100:00100000:1.0:1788793897.293037:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658496 00000100:00100000:1.0:1788793897.293073:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788793897.293081:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729658496:12345-0@lo:400: 00000100:00100000:1.0:1788793897.293146:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729658496:12345-0@lo:400: Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793897.293153:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788793897.293426:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788793897.293450:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7790e00 x1875685729658496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793897.293463:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729658496:0@lo:400: 00000100:00100000:1.0:1788793897.293499:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658752 00000100:00100000:1.0:1788793897.293503:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658752 00000100:00100000:1.0:1788793897.293525:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788793897.293533:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788793897.293538:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729658240:12345-0@lo:400: 00000100:00100000:1.0:1788793897.293589:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3462:x1875685729658240:12345-0@lo:400: Request processed in 51us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793897.293596:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788793897.293609:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788793897.293615:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788793897.293621:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1875685729658752:12345-0@lo:400: 00000100:00100000:1.0:1788793897.293653:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1875685729658752:12345-0@lo:400: Request processed in 33us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793897.293670:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788793897.293685:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788793897.294102:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4c4085500 x1875685729658624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793897.294141:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729658624:0@lo:13: 00010000:00080000:2.0:1788793897.294163:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7791f80 x1875685729658240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793897.294174:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3462:1875685729658240:0@lo:400: 00010000:00080000:2.0:1788793897.294227:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7793800 x1875685729658752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793897.294237:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3461:1875685729658752:0@lo:400: 00000100:00100000:3.0:1788793897.298505:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3463:x1875685729658368:12345-0@lo:400: Request processed in 5775us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793897.298525:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788793897.301837:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7793100 x1875685729658368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793897.301868:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3463:1875685729658368:0@lo:400: 00010000:00010000:2.0:1788793898.318558:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793899.339354:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793899.345120:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729658880:0@lo:13: 00000100:00100000:3.0:1788793899.345258:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793899.345743:0:7521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729658880 00000100:00100000:0.0:1788793899.345755:0:7521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729658880 00000100:00100000:0.0:1788793899.345843:0:7521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788793899.345855:0:7521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729658880:12345-0@lo:13: 00002000:00000024:0.0:1788793899.345908:0:7521:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793899.345981:0:7521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729658880:12345-0@lo:13: Request processed in 128us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793899.345989:0:7521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788793899.346481:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793899.346732:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d3480 x1875685729658880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793899.346764:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729658880:0@lo:13: 00000100:00100000:1.0:1788793900.105594:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.105798:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707612544 00000100:00100000:2.0:1788793900.105813:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707612544 00000100:00100000:2.0:1788793900.105930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:2.0:1788793900.105942:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2369:x1875685707612544:12345-192.168.201.8@tcp:250: 00010000:00080000:2.0:1788793900.105979:0:6524:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2abe3cab-b632-4e65-86e0-311de8a706de@192.168.201.8@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:2.0:1788793900.106018:0:6524:0:(genops.c:1375:class_connect()) connect: client 2abe3cab-b632-4e65-86e0-311de8a706de, cookie 0x962a5e377b33aa16 00000100:00080000:2.0:1788793900.106579:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9af4fe567000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788793900.106763:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+5:2369:x1875685707612544:12345-192.168.201.8@tcp:250: Request processed in 820us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793900.106773:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:3.0:1788793900.112413:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.112866:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707612416 00000100:00100000:2.0:1788793900.112880:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707612416 00000100:00100000:2.0:1788793900.112977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:2.0:1788793900.112990:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+5:6835:x1875685707612416:12345-192.168.201.8@tcp:101: 00010000:00010000:2.0:1788793900.113013:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793900.113041:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6bde expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793900.113078:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793900.113091:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793900.113102:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b60400, rc 0) 00000100:00100000:2.0:1788793900.113385:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+6:6835:x1875685707612416:12345-192.168.201.8@tcp:101: Request processed in 397us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793900.113393:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:1.0:1788793900.117862:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.119377:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707612672 00000100:00100000:2.0:1788793900.119396:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707612672 00000100:00100000:2.0:1788793900.119809:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:2.0:1788793900.119827:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+6:6835:x1875685707612672:12345-192.168.201.8@tcp:501: 00000100:00100000:2.0:1788793900.119995:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+6:6835:x1875685707612672:12345-192.168.201.8@tcp:501: Request processed in 174us (2147us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788793900.120026:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:1.0:1788793900.129611:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793900.130072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707612800 00000100:00100000:0.0:1788793900.130083:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707612800 00000100:00100000:0.0:1788793900.130426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:0.0:1788793900.130438:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+6:6835:x1875685707612800:12345-192.168.201.8@tcp:101: 00010000:00010000:0.0:1788793900.130457:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793900.130477:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6be5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793900.130508:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793900.130520:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793900.130529:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55b600, rc 0) 00000100:00100000:0.0:1788793900.130594:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+7:6835:x1875685707612800:12345-192.168.201.8@tcp:101: Request processed in 159us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793900.130615:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:3.0:1788793900.135227:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.135381:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707612928 00000100:00100000:2.0:1788793900.135393:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707612928 00000100:00100000:2.0:1788793900.135478:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:2.0:1788793900.135490:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+7:6835:x1875685707612928:12345-192.168.201.8@tcp:501: 00000100:00100000:2.0:1788793900.135638:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+8:6835:x1875685707612928:12345-192.168.201.8@tcp:501: Request processed in 151us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793900.135758:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:1.0:1788793900.144870:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.145010:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613056 00000100:00100000:2.0:1788793900.145020:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613056 00000100:00100000:2.0:1788793900.145096:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:2.0:1788793900.145108:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+8:6835:x1875685707613056:12345-192.168.201.8@tcp:503: 00000100:00100000:2.0:1788793900.145294:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+8:6835:x1875685707613056:12345-192.168.201.8@tcp:503: Request processed in 188us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793900.145302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:1.0:1788793900.148741:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793900.152076:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613184 00000100:00100000:0.0:1788793900.152093:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613184 00000100:00100000:0.0:1788793900.152523:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:0.0:1788793900.152537:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+8:6853:x1875685707613184:12345-192.168.201.8@tcp:502: 00000100:00100000:0.0:1788793900.152716:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+8:6853:x1875685707613184:12345-192.168.201.8@tcp:502: Request processed in 178us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793900.152724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:3.0:1788793900.178675:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793900.180093:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613312 00000100:00100000:1.0:1788793900.180107:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613312 00000100:00100000:1.0:1788793900.180193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:1.0:1788793900.180216:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+8:6853:x1875685707613312:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1788793900.180392:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+8:6853:x1875685707613312:12345-192.168.201.8@tcp:502: Request processed in 178us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793900.180400:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:1.0:1788793900.187421:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793900.187756:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613440 00000100:00100000:0.0:1788793900.187767:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613440 00000100:00100000:0.0:1788793900.189063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:0.0:1788793900.189081:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+8:6835:x1875685707613440:12345-192.168.201.8@tcp:101: 00010000:00010000:0.0:1788793900.189099:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793900.189118:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55a200/0x962a5e377b33aa2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c0f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793900.189160:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55a200/0x962a5e377b33aa2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c0f expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793900.189171:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55a200/0x962a5e377b33aa2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c0f expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793900.189180:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55a200, rc 0) 00000100:00100000:0.0:1788793900.189236:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6835:x1875685707613440:12345-192.168.201.8@tcp:101: Request processed in 162us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793900.189244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:2.0:1788793900.201544:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793900.201661:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613568 00000100:00100000:1.0:1788793900.201672:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613568 00000100:00100000:1.0:1788793900.201732:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:1.0:1788793900.201742:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:6835:x1875685707613568:12345-192.168.201.8@tcp:256: 20000000:01000000:1.0:1788793900.201769:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788793900.201794:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788793900.201798:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788793900.201801:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788793900.201804:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788793900.214850:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:6835:x1875685707613568:12345-192.168.201.8@tcp:256: Request processed in 13099us (13305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793900.214865:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:3.0:1788793900.218179:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.218288:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613696 00000100:00100000:2.0:1788793900.218300:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613696 00000100:00100000:2.0:1788793900.218375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 126 00000100:00100000:2.0:1788793900.218388:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6835:x1875685707613696:12345-192.168.201.8@tcp:101: 00010000:00010000:2.0:1788793900.218404:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793900.218423:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c16 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793900.218452:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793900.218485:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793900.218494:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b60a00, rc 0) 00000100:00100000:2.0:1788793900.218558:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:6835:x1875685707613696:12345-192.168.201.8@tcp:101: Request processed in 174us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793900.218566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 126 00000100:00100000:2.0:1788793900.221754:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793900.221853:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613824 00000100:00100000:1.0:1788793900.221862:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613824 00000100:00100000:1.0:1788793900.221918:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:1.0:1788793900.221928:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6835:x1875685707613824:12345-192.168.201.8@tcp:501: 00000100:00100000:1.0:1788793900.222081:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6835:x1875685707613824:12345-192.168.201.8@tcp:501: Request processed in 155us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793900.222100:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:3.0:1788793900.225256:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793900.225582:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707613952 00000100:00100000:0.0:1788793900.225607:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707613952 00000100:00100000:0.0:1788793900.225674:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 128 00000100:00100000:0.0:1788793900.225684:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6835:x1875685707613952:12345-192.168.201.8@tcp:503: 00000100:00100000:0.0:1788793900.225831:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6835:x1875685707613952:12345-192.168.201.8@tcp:503: Request processed in 148us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793900.225839:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 128 00000100:00100000:3.0:1788793900.230981:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793900.231160:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614080 00000100:00100000:2.0:1788793900.231171:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614080 00000100:00100000:2.0:1788793900.231242:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 129 00000100:00100000:2.0:1788793900.231254:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:6858:x1875685707614080:12345-192.168.201.8@tcp:502: 00000100:00100000:2.0:1788793900.231422:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:6858:x1875685707614080:12345-192.168.201.8@tcp:502: Request processed in 171us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793900.231431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 129 00000100:00100000:2.0:1788793900.236417:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793900.236562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614208 00000100:00100000:1.0:1788793900.236574:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614208 00000100:00100000:1.0:1788793900.236634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 130 00000100:00100000:1.0:1788793900.236653:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6858:x1875685707614208:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1788793900.236809:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6858:x1875685707614208:12345-192.168.201.8@tcp:502: Request processed in 166us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793900.236818:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 130 00000100:00100000:3.0:1788793900.247307:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793900.247743:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614336 00000100:00100000:1.0:1788793900.247753:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614336 00000100:00100000:1.0:1788793900.247811:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:1.0:1788793900.247820:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2369:x1875685707614336:12345-192.168.201.8@tcp:38: 00010000:00080000:1.0:1788793900.247853:0:6530:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0a13e557-9164-462f-8696-12fb9eb0378a@192.168.201.8@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1788793900.247905:0:6530:0:(genops.c:1375:class_connect()) connect: client 0a13e557-9164-462f-8696-12fb9eb0378a, cookie 0x962a5e377b33aa39 00000004:00100000:1.0:1788793900.247933:0:6530:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788793900.247940:0:6530:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788793900.257198:0:6530:0:(import.c:65:import_set_state_nolock()) ffff9af4cdbe9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788793900.257288:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a13e557-9164-462f-8696-12fb9eb0378a+6:2369:x1875685707614336:12345-192.168.201.8@tcp:38: Request processed in 9466us (9990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793900.257300:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00010000:00010000:0.0:1788793900.363579:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793901.270893:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793901.270951:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793901.271034:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614592 00000100:00100000:3.0:1788793901.271046:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614592 00000100:00100000:3.0:1788793901.271167:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614464 00000100:00100000:3.0:1788793901.271171:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614464 00000100:00100000:3.0:1788793901.271196:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:3.0:1788793901.271205:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+7:6835:x1875685707614592:12345-192.168.201.8@tcp:41: 00000100:00100000:0.0:1788793901.271215:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:0.0:1788793901.271222:0:9223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a13e557-9164-462f-8696-12fb9eb0378a+7:0:x1875685707614464:12345-192.168.201.8@tcp:41: 00000004:00000024:0.0:1788793901.271244:0:9223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000004:00000024:3.0:1788793901.271244:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00080000:1.0:1788793901.271343:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788793901.271413:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+7:6835:x1875685707614592:12345-192.168.201.8@tcp:41: Request processed in 208us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793901.271420:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1788793901.279242:0:9223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:0:x1875685707614464:12345-192.168.201.8@tcp:41: Request processed in 8005us (8275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793901.279257:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1788793901.293950:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793901.299016:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614720 00000100:00100000:1.0:1788793901.299038:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614720 00000100:00100000:1.0:1788793901.299194:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:2.0:1788793901.299744:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a13e557-9164-462f-8696-12fb9eb0378a+6:6835:x1875685707614720:12345-192.168.201.8@tcp:40: 00000100:00100000:2.0:1788793901.299873:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a13e557-9164-462f-8696-12fb9eb0378a+6:6835:x1875685707614720:12345-192.168.201.8@tcp:40: Request processed in 635us (5939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793901.299882:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:1.0:1788793901.308738:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793901.308782:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793901.308814:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793901.308870:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614976 00000100:00100000:0.0:1788793901.308893:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614976 00000100:00100000:3.0:1788793901.308909:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615232 00000100:00100000:3.0:1788793901.308920:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615232 00000100:00100000:3.0:1788793901.308987:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:3.0:1788793901.308998:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a13e557-9164-462f-8696-12fb9eb0378a+6:6835:x1875685707615232:12345-192.168.201.8@tcp:33: 00000100:00100000:2.0:1788793901.313699:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707614848 00000100:00100000:2.0:1788793901.313721:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707614848 00000100:00100000:2.0:1788793901.313852:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:2.0:1788793901.313864:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1875685707614848:12345-192.168.201.8@tcp:8: 00010000:00080000:2.0:1788793901.313927:0:7516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0a13e557-9164-462f-8696-12fb9eb0378a@192.168.201.8@tcp t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:2.0:1788793901.313982:0:7516:0:(genops.c:1375:class_connect()) connect: client 0a13e557-9164-462f-8696-12fb9eb0378a, cookie 0x962a5e377b33aa40 00002000:00100000:2.0:1788793901.313997:0:7516:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0a13e557-9164-462f-8696-12fb9eb0378a/ffff9af4fe560800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788793901.314026:0:7516:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788793901.314355:0:7516:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788793901.314399:0:7516:0:(import.c:65:import_set_state_nolock()) ffff9af4fe566000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788793901.314422:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 131 00000100:00100000:0.0:1788793901.314445:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707614976:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1788793901.314511:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a13e557-9164-462f-8696-12fb9eb0378a+6:2369:x1875685707614848:12345-192.168.201.8@tcp:8: Request processed in 646us (5788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793901.314523:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707614976:12345-192.168.201.8@tcp:400: Request processed in 84us (5734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793901.314534:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1788793901.314543:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 131 00000100:00100000:0.0:1788793901.321790:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793901.329084:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615104 00000100:00100000:1.0:1788793901.329108:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615104 00000100:00100000:1.0:1788793901.330401:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:1.0:1788793901.330857:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1875685707615104:12345-192.168.201.8@tcp:8: 00010000:00080000:1.0:1788793901.330912:0:8967:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0a13e557-9164-462f-8696-12fb9eb0378a@192.168.201.8@tcp t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:1.0:1788793901.330962:0:8967:0:(genops.c:1375:class_connect()) connect: client 0a13e557-9164-462f-8696-12fb9eb0378a, cookie 0x962a5e377b33aa47 00002000:00100000:1.0:1788793901.331039:0:8967:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0a13e557-9164-462f-8696-12fb9eb0378a/ffff9af4cdbea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788793901.331065:0:8967:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788793901.331384:0:8967:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788793901.331523:0:8967:0:(import.c:65:import_set_state_nolock()) ffff9af4cdbef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788793901.331668:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2369:x1875685707615104:12345-192.168.201.8@tcp:8: Request processed in 819us (9887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793901.331678:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000004:00080000:2.0:1788793901.352011:0:6532:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42887us 00000004:00200000:2.0:1788793901.384866:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788793901.385054:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a13e557-9164-462f-8696-12fb9eb0378a+6:6835:x1875685707615232:12345-192.168.201.8@tcp:33: Request processed in 76047us (76228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793901.385073:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00010000:00010000:2.0:1788793901.387453:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793901.623578:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793901.623742:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615360 00000100:00100000:2.0:1788793901.623759:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615360 00000100:00100000:2.0:1788793901.623881:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:2.0:1788793901.623896:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a13e557-9164-462f-8696-12fb9eb0378a+6:6875:x1875685707615360:12345-192.168.201.8@tcp:101: 00010000:00010000:2.0:1788793901.623923:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793901.630003:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b61e00/0x962a5e377b33aa4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793901.630098:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b60c00/0x962a5e377b33aa55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793901.630150:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b60c00/0x962a5e377b33aa55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793901.630166:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b60c00/0x962a5e377b33aa55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788793901.630217:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788793901.630222:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788793901.630239:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b60c00/0x962a5e377b33aa55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793901.630269:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b61e00/0x962a5e377b33aa4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c40 expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793901.630608:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9af501b60c00/0x962a5e377b33aa55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c40 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793901.630626:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9af4f773ea00) 00010000:00010000:2.0:1788793901.630629:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788793901.630633:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b60c00, rc 0) 00000100:00100000:2.0:1788793901.630718:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a13e557-9164-462f-8696-12fb9eb0378a+7:6875:x1875685707615360:12345-192.168.201.8@tcp:101: Request processed in 6826us (7162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793901.630726:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00010000:00010000:0.0:1788793902.411415:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793902.411563:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788793902.411600:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729659392:0@lo:400: 00000100:00100000:3.0:1788793902.411657:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729659264:0@lo:400: 00000100:00100000:2.0:1788793902.411970:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729659520:0@lo:400: 00000100:00100000:1.0:1788793902.412701:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729659136:0@lo:400: 00000100:00100000:0.0:1788793902.418333:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793902.418520:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729659008:0@lo:400: 00000100:00100000:0.0:1788793902.418612:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793902.418690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659008 00000100:00100000:0.0:1788793902.418702:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659008 00000100:00100000:0.0:1788793902.418764:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788793902.418775:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3463:x1875685729659008:12345-0@lo:400: 00000100:00100000:0.0:1788793902.418839:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3463:x1875685729659008:12345-0@lo:400: Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793902.418848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788793902.418912:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729659008:0@lo:400: 00000100:00100000:0.0:1788793902.418959:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659392 00000100:00100000:0.0:1788793902.418964:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659392 00000100:00100000:0.0:1788793902.419007:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793902.419014:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729659392:12345-0@lo:400: 00000100:00100000:0.0:1788793902.419055:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729659392:12345-0@lo:400: Request processed in 41us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793902.419061:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788793902.419083:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788793902.419216:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f730d180 x1875685729659392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793902.419229:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729659392:0@lo:400: 00000100:00100000:3.0:1788793902.422592:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793902.422680:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729659776:0@lo:13: 00000100:00100000:3.0:1788793902.422729:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793902.422780:0:7521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659776 00000100:00100000:3.0:1788793902.422789:0:7521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659776 00000100:00100000:3.0:1788793902.422851:0:7521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788793902.422861:0:7521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729659776:12345-0@lo:13: 00002000:00000024:3.0:1788793902.422884:0:7521:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788793902.422944:0:7521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729659776:12345-0@lo:13: Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793902.422951:0:7521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788793902.422988:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788793902.423012:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7792680 x1875685729659776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793902.423030:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729659776:0@lo:13: 00000100:00100000:0.0:1788793902.427301:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659264 00000100:00100000:0.0:1788793902.427324:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659264 00000100:00100000:0.0:1788793902.427458:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788793902.427474:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729659264:12345-0@lo:400: 00000100:00080000:3.0:1788793902.427491:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788793902.427600:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3462:x1875685729659264:12345-0@lo:400: Request processed in 131us (5016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793902.427637:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788793902.427683:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3462:1875685729659264:0@lo:400: 00000100:00100000:2.0:1788793902.430882:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793902.432303:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659520 00000100:00100000:0.0:1788793902.432323:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659520 00000100:00100000:0.0:1788793902.432567:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788793902.432568:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788793902.432586:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729659520:12345-0@lo:400: 00000100:00100000:0.0:1788793902.432748:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729659520:12345-0@lo:400: Request processed in 170us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793902.432757:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788793902.432824:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729659520:0@lo:400: 00000100:00100000:1.0:1788793902.435255:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793902.435311:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729659648:0@lo:400: 00000100:00100000:3.0:1788793902.435334:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659136 00000100:00100000:3.0:1788793902.435346:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659136 00000100:00100000:1.0:1788793902.435353:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793902.435412:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788793902.435529:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659648 00000100:00100000:2.0:1788793902.435541:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659648 00000100:00100000:2.0:1788793902.435648:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788793902.435684:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729659648:12345-0@lo:400: 00000100:00100000:2.0:1788793902.435780:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729659648:12345-0@lo:400: Request processed in 105us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793902.435788:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788793902.436314:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729659136:12345-0@lo:400: 00000100:00100000:3.0:1788793902.436711:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729659136:12345-0@lo:400: Request processed in 1288us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793902.436720:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788793902.436864:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729659136:0@lo:400: 00010000:00080000:1.0:1788793902.436887:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f730ca80 x1875685729659648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793902.436901:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729659648:0@lo:400: 00010000:00010000:0.0:1788793903.436774:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793903.935259:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793903.935937:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615488 00000100:00100000:2.0:1788793903.935951:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615488 00000100:00100000:2.0:1788793903.936091:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:2.0:1788793903.936121:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a13e557-9164-462f-8696-12fb9eb0378a+7:6934:x1875685707615488:12345-192.168.201.8@tcp:41: 00000004:00000024:2.0:1788793903.936205:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1788793903.939523:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a13e557-9164-462f-8696-12fb9eb0378a+7:6934:x1875685707615488:12345-192.168.201.8@tcp:41: Request processed in 3397us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793903.939549:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00080000:3.0:1788793903.941427:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788793903.953936:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793903.954390:0:7521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615616 00000100:00100000:3.0:1788793903.954404:0:7521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615616 00000100:00100000:3.0:1788793903.954597:0:7521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:3.0:1788793903.954610:0:7521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a13e557-9164-462f-8696-12fb9eb0378a+6:6934:x1875685707615616:12345-192.168.201.8@tcp:13: 00002000:00000024:3.0:1788793903.954653:0:7521:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788793903.955059:0:7521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a13e557-9164-462f-8696-12fb9eb0378a+6:6934:x1875685707615616:12345-192.168.201.8@tcp:13: Request processed in 450us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793903.955093:0:7521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00080000:0.0:1788793903.957712:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788793903.960226:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793903.960520:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615744 00000100:00100000:2.0:1788793903.960533:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615744 00000100:00100000:2.0:1788793903.960665:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1788793903.960699:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a13e557-9164-462f-8696-12fb9eb0378a+6:6934:x1875685707615744:12345-192.168.201.8@tcp:13: 00002000:00000024:2.0:1788793903.960825:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788793903.960964:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a13e557-9164-462f-8696-12fb9eb0378a+6:6934:x1875685707615744:12345-192.168.201.8@tcp:13: Request processed in 287us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793903.960973:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00080000:0.0:1788793903.961348:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788793904.465260:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729659904:0@lo:13: 00000100:00100000:3.0:1788793904.465366:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793904.465539:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729659904 00000100:00100000:0.0:1788793904.465550:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729659904 00000100:00100000:0.0:1788793904.465634:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788793904.465643:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729659904:12345-0@lo:13: 00002000:00000024:0.0:1788793904.465672:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793904.465725:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729659904:12345-0@lo:13: Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793904.465733:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788793904.465782:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d0700 x1875685729659904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793904.465806:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729659904:0@lo:13: 00000100:00080000:3.0:1788793904.466273:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788793904.467804:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793905.483372:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793906.507343:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788793906.518086:0:6507:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a13e557-9164-462f-8696-12fb9eb0378a 00000100:00100000:2.0:1788793906.641377:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793906.641481:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793906.641537:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616000 00000100:00100000:2.0:1788793906.641550:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616000 00000100:00100000:2.0:1788793906.641641:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:2.0:1788793906.641655:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+6:2373:x1875685707616000:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1788793906.641755:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+6:2373:x1875685707616000:12345-192.168.201.8@tcp:400: Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793906.641763:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00080000:3.0:1788793906.641874:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788793906.649648:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707615872 00000100:00100000:1.0:1788793906.649667:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707615872 00000100:00100000:1.0:1788793906.649749:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:1.0:1788793906.649762:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2373:x1875685707615872:12345-192.168.201.8@tcp:400: 00000100:00100000:1.0:1788793906.649876:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2373:x1875685707615872:12345-192.168.201.8@tcp:400: Request processed in 116us (8513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793906.649884:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:1.0:1788793906.650027:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793906.650340:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616128 00000100:00100000:0.0:1788793906.650357:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616128 00000100:00100000:0.0:1788793906.650407:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1788793906.650416:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2373:x1875685707616128:12345-192.168.201.8@tcp:400: 00000100:00100000:0.0:1788793906.650458:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2373:x1875685707616128:12345-192.168.201.8@tcp:400: Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793906.650465:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00080000:1.0:1788793906.651268:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788793906.661435:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793906.661493:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616256 00000100:00100000:3.0:1788793906.661507:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616256 00000100:00080000:2.0:1788793906.661592:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788793906.661633:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:3.0:1788793906.661647:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a13e557-9164-462f-8696-12fb9eb0378a+6:2372:x1875685707616256:12345-192.168.201.8@tcp:400: 00000100:00100000:3.0:1788793906.661748:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a13e557-9164-462f-8696-12fb9eb0378a+6:2372:x1875685707616256:12345-192.168.201.8@tcp:400: Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793906.661756:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000001:02000400:2.0:1788793906.769051:0:9311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788793907.021081:0:7512:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a13e557-9164-462f-8696-12fb9eb0378a 00000001:00100000:1.0:1788793907.021239:0:8587:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a13e557-9164-462f-8696-12fb9eb0378a 00000100:00100000:0.0:1788793907.531449:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729660032:0@lo:400: 00010000:00010000:3.0:1788793907.531449:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793907.531479:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729660416:0@lo:400: 00000100:00100000:3.0:1788793907.537919:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793907.538042:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729660160:0@lo:400: 00000100:00100000:3.0:1788793907.538095:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793907.538120:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729660672:0@lo:400: 00000100:00100000:3.0:1788793907.538154:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793907.538179:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788793907.538185:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729660288:0@lo:400: 00000100:00100000:3.0:1788793907.538204:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793907.538219:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729660800:0@lo:13: 00000100:00100000:3.0:1788793907.538238:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793907.538270:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660160 00000100:00100000:3.0:1788793907.538292:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660160 00000100:00100000:2.0:1788793907.539025:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660288 00000100:00100000:2.0:1788793907.539031:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660288 00000100:00100000:2.0:1788793907.539076:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788793907.539100:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729660160:12345-0@lo:400: 00000100:00100000:2.0:1788793907.539211:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729660160:12345-0@lo:400: Request processed in 126us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793907.539218:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788793907.539237:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788793907.539244:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729660288:12345-0@lo:400: 00000100:00100000:2.0:1788793907.539266:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729660288:12345-0@lo:400: Request processed in 24us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793907.539272:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788793907.539289:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660416 00000100:00100000:2.0:1788793907.539293:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660416 00000100:00100000:2.0:1788793907.539315:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660672 00000100:00100000:2.0:1788793907.539318:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660672 00000100:00100000:2.0:1788793907.539336:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788793907.539343:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729660416:12345-0@lo:400: 00000100:00100000:2.0:1788793907.539373:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729660416:12345-0@lo:400: Request processed in 32us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793907.539379:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788793907.539398:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788793907.539404:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729660672:12345-0@lo:400: 00000100:00100000:2.0:1788793907.539431:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729660672:12345-0@lo:400: Request processed in 28us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793907.539437:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788793907.539451:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788793907.539456:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788793907.539458:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788793907.539501:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729660288:0@lo:400: 00000100:00100000:2.0:1788793907.539524:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729660160:0@lo:400: 00010000:00080000:2.0:1788793907.539540:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f730ed80 x1875685729660672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793907.541758:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793907.541831:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660032 00000100:00100000:0.0:1788793907.541840:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660032 00000100:00100000:0.0:1788793907.541898:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788793907.541909:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729660032:12345-0@lo:400: 00000100:00100000:0.0:1788793907.541992:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729660032:12345-0@lo:400: Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793907.542000:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788793907.542083:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729660032:0@lo:400: 00000100:00100000:0.0:1788793907.542097:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729660544:0@lo:400: 00000100:00100000:0.0:1788793907.542153:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793907.543618:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729660672:0@lo:400: 00010000:00080000:2.0:1788793907.543708:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f730ce00 x1875685729660416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793907.543720:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729660416:0@lo:400: 00000100:00100000:0.0:1788793907.543994:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660544 00000100:00100000:0.0:1788793907.544003:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660544 00000100:00080000:3.0:1788793907.544053:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788793907.544154:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788793907.544166:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729660544:12345-0@lo:400: 00000100:00100000:0.0:1788793907.544265:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729660544:12345-0@lo:400: Request processed in 101us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793907.544272:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788793907.544297:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660800 00000100:00100000:0.0:1788793907.544311:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660800 00000100:00100000:0.0:1788793907.544339:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788793907.544346:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729660800:12345-0@lo:13: 00002000:00000024:0.0:1788793907.544373:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793907.544413:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729660800:12345-0@lo:13: Request processed in 68us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793907.544420:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788793907.544452:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729660544:0@lo:400: 00010000:00080000:3.0:1788793907.544560:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7792680 x1875685729660800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793907.544578:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729660800:0@lo:13: 00010000:00010000:0.0:1788793908.555270:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793909.579380:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793909.579436:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788793909.579460:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729660928:0@lo:13: 00000100:00100000:3.0:1788793909.579537:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793909.579696:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729660928 00000100:00100000:0.0:1788793909.579704:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729660928 00000100:00100000:0.0:1788793909.579769:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788793909.579778:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729660928:12345-0@lo:13: 00002000:00000024:0.0:1788793909.579803:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788793909.579850:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729660928:12345-0@lo:13: Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793909.579857:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788793909.579897:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d2a00 x1875685729660928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793909.579915:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729660928:0@lo:13: 00000100:00080000:3.0:1788793909.581203:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788793910.237323:0:9459:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde5693260 20000000:00000080:0.0:1788793910.237342:0:9459:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af4f75ea400 uarg=0000000000000000 20000000:01000000:0.0:1788793910.237531:0:9459:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788793910.237533:0:9459:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788793910.237536:0:9459:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788793910.237617:0:9459:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788793910.237628:0:9459:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788793910.237699:0:9459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788793910.237702:0:9459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788793910.238320:0:9460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788793910.238760:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788793910.238789:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788793910.238806:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788793910.238816:0:9459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788793910.238818:0:9459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793910.239071:0:9461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788793910.239252:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788793910.239273:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788793910.239288:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788793910.239297:0:9459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788793910.239299:0:9459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793910.239838:0:9462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788793910.240017:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788793910.240040:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788793910.240055:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788793910.240063:0:9459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788793910.240065:0:9459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793910.240787:0:9463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788793910.240948:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788793910.240970:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788793910.240986:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788793910.241001:0:9459:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788793910.241021:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241038:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a952 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241047:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a97c expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241054:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241061:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241067:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241080:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a9de expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241086:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241096:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241103:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241111:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241350:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241366:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 9 pid: 6523 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.241458:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661056:192.168.201.8@tcp:104: 00010000:00010000:0.0:1788793910.241678:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241688:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 9 pid: 6522 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.241698:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661184:192.168.201.8@tcp:104: 00010000:00010000:0.0:1788793910.241737:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241745:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 18 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.241754:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661312:0@lo:104: 00000100:00100000:0.0:1788793910.241794:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793910.241836:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a9de expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.241844:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a9de expref: 18 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.241853:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661440:0@lo:104: 00000100:00100000:0.0:1788793910.241872:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793910.241901:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788793910.241911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729661312 00000100:00100000:0.0:1788793910.241918:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729661312 00000100:00100000:0.0:1788793910.241946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729661440 00000100:00100000:0.0:1788793910.241949:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729661440 00000100:00100000:0.0:1788793910.241959:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788793910.241966:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9459:x1875685729661312:12345-0@lo:104: 00010000:00010000:0.0:1788793910.241976:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242015:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793910.242020:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9459:x1875685729661312:12345-0@lo:104: Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793910.242036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788793910.242051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788793910.242056:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9db7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729661440:12345-0@lo:104: 00010000:00010000:0.0:1788793910.242062:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242090:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788793910.242095:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9db7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729661440:12345-0@lo:104: Request processed in 39us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793910.242099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788793910.242153:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788793910.242159:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242166:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513600 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793910.242170:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242178:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793910.242185:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793910.242191:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793910.242217:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242223:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793910.242242:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242248:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513600/0x962a5e377b33aa08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa0f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242259:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793910.242262:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242268:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d0c00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793910.242270:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242276:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793910.242282:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793910.242286:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793910.242296:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242301:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793910.242310:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242316:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0c00/0x962a5e377b33a9de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9e5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242323:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.242328:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.242330:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793910.242342:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729661568:0@lo:103: 00000100:00100000:0.0:1788793910.242367:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793910.242484:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729661568 00000100:00100000:0.0:1788793910.242488:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729661568 00010000:00010000:0.0:1788793910.242518:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 19 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.242613:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788793910.242619:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729661568:12345-0@lo:103: 00010000:00010000:0.0:1788793910.242628:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793910.242632:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 19 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242639:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 19 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242653:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793910.242677:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729661568:12345-0@lo:103: Request processed in 59us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793910.242682:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788793910.242709:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729661568:0@lo:103: 00010000:00010000:0.0:1788793910.242736:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242744:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 18 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.242753:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661824:0@lo:104: 00000100:00100000:0.0:1788793910.242779:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793910.242798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729661824 00000100:00100000:0.0:1788793910.242801:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729661824 00000100:00100000:0.0:1788793910.242817:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788793910.242822:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729661824:12345-0@lo:104: 00010000:00010000:0.0:1788793910.242829:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242855:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793910.242860:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729661824:12345-0@lo:104: Request processed in 38us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793910.242864:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788793910.242877:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793910.242881:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242887:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d1a00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793910.242890:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242897:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793910.242903:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793910.242907:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793910.242920:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242935:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793910.242942:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242947:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33a9c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9c9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242956:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.242957:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.242958:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.242975:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.242982:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 18 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.242990:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662080:0@lo:104: 00000100:00100000:0.0:1788793910.243010:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793910.243026:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662080 00000100:00100000:0.0:1788793910.243028:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662080 00000100:00100000:0.0:1788793910.243042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788793910.243047:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729662080:12345-0@lo:104: 00010000:00010000:0.0:1788793910.243053:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243078:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793910.243082:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729662080:12345-0@lo:104: Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793910.243095:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788793910.243109:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793910.243113:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243119:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1512e00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793910.243141:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243149:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793910.243155:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793910.243160:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793910.243173:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243179:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793910.243188:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243193:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33a9b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243201:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.243203:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793910.243204:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793910.243209:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788793910.243221:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729662208:0@lo:103: 00000100:00100000:0.0:1788793910.243241:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793910.243263:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662208 00000100:00100000:0.0:1788793910.243266:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662208 00010000:00010000:0.0:1788793910.243278:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 19 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.243294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788793910.243300:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729662208:12345-0@lo:103: 00010000:00010000:0.0:1788793910.243308:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793910.243311:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 19 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243318:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 19 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243328:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793910.243352:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729662208:12345-0@lo:103: Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793910.243358:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788793910.243593:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793910.243605:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729661696:0@lo:103: 00000100:00100000:0.0:1788793910.243642:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729662208:0@lo:103: 00010000:00010000:0.0:1788793910.243678:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.243688:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 18 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.243695:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4c4811c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662336:0@lo:104: 00000100:00100000:3.0:1788793910.243889:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793910.243925:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793910.243930:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729661952:0@lo:103: 00000100:00100000:3.0:1788793910.243949:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793910.243975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729661696 00000100:00100000:3.0:1788793910.243979:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729661696 00010000:00010000:3.0:1788793910.243995:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9de expref: 19 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793910.244011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729661952 00000100:00100000:3.0:1788793910.244014:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729661952 00010000:00010000:3.0:1788793910.244034:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 20 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793910.244047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788793910.244052:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3461:x1875685729661696:12345-0@lo:103: 00010000:00010000:3.0:1788793910.244061:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793910.244064:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9de expref: 20 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.244070:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a9de expref: 20 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.244080:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793910.244106:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3461:x1875685729661696:12345-0@lo:103: Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.244112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788793910.244148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788793910.244155:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729661952:12345-0@lo:103: 00010000:00010000:3.0:1788793910.244162:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793910.244166:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 19 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.244174:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 19 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.244183:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793910.244204:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729661952:12345-0@lo:103: Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.244210:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788793910.244241:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729661952:0@lo:103: 00000100:00100000:3.0:1788793910.244249:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729661696:0@lo:103: 00000100:00100000:0.0:1788793910.244344:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793910.244395:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a97c expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.244404:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a97c expref: 18 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.244412:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662464:0@lo:104: 00000100:00100000:0.0:1788793910.244434:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793910.244454:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a952 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793910.244461:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a952 expref: 18 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.244488:0:9459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662592:0@lo:104: 00000100:00100000:0.0:1788793910.244518:0:9459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793910.244530:0:9459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69d240 going to sleep for 11 seconds 00010000:00010000:0.0:1788793910.244553:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1513e00/0x962a5e377b33aa0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aa08 expref: 18 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.244564:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661312:0@lo:104: 00010000:00010000:0.0:1788793910.244574:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33a9e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a9de expref: 17 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.244583:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661440:0@lo:104: 00010000:00010000:0.0:1788793910.244593:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1512400/0x962a5e377b33a9c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a9c2 expref: 16 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.244601:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661824:0@lo:104: 00010000:00010000:0.0:1788793910.244610:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166a000/0x962a5e377b33a9bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a9b4 expref: 15 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.244625:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662080:0@lo:104: 00000100:00100000:3.0:1788793910.244843:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662336 00000100:00100000:3.0:1788793910.244848:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662336 00000100:00100000:3.0:1788793910.244866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662464 00000100:00100000:3.0:1788793910.244868:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662464 00000100:00100000:3.0:1788793910.244877:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662592 00000100:00100000:3.0:1788793910.244879:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662592 00000100:00100000:3.0:1788793910.244889:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788793910.244895:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9459:x1875685729662336:12345-0@lo:104: 00010000:00010000:3.0:1788793910.244906:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.244995:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793910.245001:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9459:x1875685729662336:12345-0@lo:104: Request processed in 106us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.245007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788793910.245020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793910.245026:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9459:x1875685729662464:12345-0@lo:104: 00010000:00010000:3.0:1788793910.245034:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.245356:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4c4811c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662336:0@lo:104: 00000100:00100000:0.0:1788793910.245363:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662464:0@lo:104: 00010000:00010000:1.0:1788793910.245686:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788793910.245693:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245700:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166b200 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793910.245703:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245710:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793910.245716:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793910.245721:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793910.245754:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245772:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788793910.245812:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729662720:0@lo:103: 00000100:00100000:0.0:1788793910.245844:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793910.245892:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245899:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33a9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a9ad expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245910:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793910.245913:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245918:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55a800 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793910.245921:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245927:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793910.245933:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793910.245937:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793910.245950:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245956:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793910.245970:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245976:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4fe55a800/0x962a5e377b33a97c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a983 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.245990:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793910.245992:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793910.245993:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793910.246000:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788793910.246009:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729662848:0@lo:103: 00000100:00100000:1.0:1788793910.246036:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793910.246062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662720 00000100:00100000:1.0:1788793910.246067:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662720 00010000:00010000:1.0:1788793910.246089:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 15 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793910.246108:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662848 00000100:00100000:1.0:1788793910.246111:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662848 00010000:00010000:1.0:1788793910.246142:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a97c expref: 16 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793910.246157:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788793910.246165:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3464:x1875685729662720:12345-0@lo:103: 00010000:00010000:1.0:1788793910.246175:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793910.246179:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 16 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.246188:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 16 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.246199:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33a9ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a9a6 expref: 16 pid: 6524 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.246212:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788793910.246329:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788793910.246336:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9459:x1875685729662464:12345-0@lo:104: Request processed in 1310us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.246343:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793910.246359:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788793910.246366:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729662592:12345-0@lo:104: 00010000:00010000:3.0:1788793910.246391:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.246433:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788793910.246438:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9459:x1875685729662592:12345-0@lo:104: Request processed in 74us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.246443:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788793910.246457:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793910.246472:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.246478:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55ba00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793910.246481:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.246488:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793910.246493:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793910.246498:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793910.246512:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.246518:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793910.246528:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.246535:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ba00/0x962a5e377b33a952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a959 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.246843:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793910.246844:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793910.246846:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793910.246854:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793910.246867:0:6514:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788793910.246874:0:6514:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788793910.247174:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788793910.247196:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:3462:x1875685729662848:12345-0@lo:103: 00010000:00010000:2.0:1788793910.247206:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793910.247211:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a97c expref: 15 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793910.247221:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a97c expref: 15 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793910.247243:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b400/0x962a5e377b33a983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a97c expref: 15 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793910.247253:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793910.247288:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3462:x1875685729662848:12345-0@lo:103: Request processed in 107us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793910.247294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788793910.247839:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3464:x1875685729662720:12345-0@lo:103: Request processed in 1674us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793910.247846:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788793910.247885:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729662976:0@lo:103: 00000100:00100000:1.0:1788793910.247922:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793910.247971:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729662848:0@lo:103: 00000100:00100000:1.0:1788793910.247999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729662976 00000100:00100000:1.0:1788793910.248004:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729662976 00010000:00010000:1.0:1788793910.248025:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a952 expref: 13 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793910.248048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788793910.248054:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3462:x1875685729662976:12345-0@lo:103: 00010000:00010000:1.0:1788793910.248061:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793910.248066:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a952 expref: 13 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.248073:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a952 expref: 13 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.248084:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793910.248109:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3462:x1875685729662976:12345-0@lo:103: Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793910.248114:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788793910.248177:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729662976:0@lo:103: 00010000:00010000:1.0:1788793910.251250:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33a959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a952 expref: 12 pid: 6522 timeout: 867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793910.251283:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af501aace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729662592:0@lo:104: 00000100:00100000:0.0:1788793910.253579:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729662720:0@lo:103: 00000100:00100000:1.0:1788793910.254110:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661056:192.168.201.8@tcp:104: 00000100:00100000:1.0:1788793910.254153:0:9459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9459:1875685729661184:192.168.201.8@tcp:104: 00010000:00010000:1.0:1788793910.254201:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793910.261970:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793910.262001:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793910.262052:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616512 00000100:00100000:3.0:1788793910.262060:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616512 00010000:00010000:3.0:1788793910.262109:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 10 pid: 6522 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793910.262172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616384 00000100:00100000:3.0:1788793910.262176:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616384 00010000:00010000:3.0:1788793910.262189:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 11 pid: 6523 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793910.262212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:3.0:1788793910.262221:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2abe3cab-b632-4e65-86e0-311de8a706de+11:2370:x1875685707616512:12345-192.168.201.8@tcp:103: 00010000:00010000:3.0:1788793910.262236:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793910.262242:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 11 pid: 6522 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262252:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 11 pid: 6522 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262269:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af501b60400/0x962a5e377b33aa1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6bde expref: 11 pid: 6522 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262282:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793910.262348:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2abe3cab-b632-4e65-86e0-311de8a706de+10:2370:x1875685707616512:12345-192.168.201.8@tcp:103: Request processed in 128us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.262355:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:3.0:1788793910.262373:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:3.0:1788793910.262394:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2abe3cab-b632-4e65-86e0-311de8a706de+9:2370:x1875685707616384:12345-192.168.201.8@tcp:103: 00010000:00010000:3.0:1788793910.262403:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793910.262408:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 9 pid: 6523 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262418:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 9 pid: 6523 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262429:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4fe55b600/0x962a5e377b33aa24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6be5 expref: 9 pid: 6523 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262440:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262448:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262472:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262480:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262486:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262493:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262506:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55ae00 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:3.0:1788793910.262510:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262519:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262531:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793910.262553:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793910.262620:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2abe3cab-b632-4e65-86e0-311de8a706de+8:2370:x1875685707616384:12345-192.168.201.8@tcp:103: Request processed in 241us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793910.262627:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:1.0:1788793910.262860:0:9459:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.262867:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.262871:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4fe55ae00/0x962a5e377b33aa5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793910.606763:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793911.627675:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788793911.691693:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793911.691704:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4fa80f000 from 39 10000000:01000000:2.0:1788793911.691710:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793911.691765:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.691780:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.691793:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793911.691817:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663104:0@lo:101: 00000100:00100000:2.0:1788793911.691885:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.692103:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663104 00000100:00100000:0.0:1788793911.692113:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663104 00000100:00100000:0.0:1788793911.692201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788793911.692210:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729663104:12345-0@lo:101: 00010000:00010000:0.0:1788793911.692224:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793911.692239:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aa63 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.692264:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.692274:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.692282:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55ac00, rc 0) 00000100:00100000:0.0:1788793911.692330:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729663104:12345-0@lo:101: Request processed in 121us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.692336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788793911.692994:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.693021:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663104:0@lo:101: 00010000:00010000:2.0:1788793911.693039:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.693049:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793911.693145:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663232:0@lo:501: 00000100:00100000:2.0:1788793911.693177:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.693245:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663232 00000100:00100000:0.0:1788793911.693251:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663232 00000100:00100000:0.0:1788793911.693296:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788793911.693304:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729663232:12345-0@lo:501: 00000100:00100000:0.0:1788793911.693391:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729663232:12345-0@lo:501: Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.693396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788793911.697112:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.697165:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663232:0@lo:501: 00000100:00100000:2.0:1788793911.697251:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663360:0@lo:503: 00000100:00100000:2.0:1788793911.697397:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.697501:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.702553:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663360 00000100:00100000:1.0:1788793911.702571:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663360 00000100:00100000:1.0:1788793911.702645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788793911.702656:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729663360:12345-0@lo:503: 00000100:00100000:1.0:1788793911.702847:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729663360:12345-0@lo:503: Request processed in 193us (5449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.702855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788793911.703001:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663360:0@lo:503: 00000100:00100000:2.0:1788793911.703535:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9476:1875685729663488:0@lo:502: 00000100:00100000:2.0:1788793911.703571:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.703599:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.703877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663488 00000100:00100000:1.0:1788793911.703882:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663488 00000100:00100000:1.0:1788793911.703912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788793911.703917:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:9476:x1875685729663488:12345-0@lo:502: 00000100:00100000:1.0:1788793911.704040:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:9476:x1875685729663488:12345-0@lo:502: Request processed in 121us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.704045:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788793911.704203:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9476:1875685729663488:0@lo:502: 00000100:00100000:2.0:1788793911.704242:0:9476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9476:1875685729663616:0@lo:502: 00000100:00100000:2.0:1788793911.704268:0:9476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.704297:0:9476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793911.704383:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663616 00000100:00100000:0.0:1788793911.704386:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663616 00000100:00100000:0.0:1788793911.704410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788793911.704414:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:9476:x1875685729663616:12345-0@lo:502: 00000100:00100000:0.0:1788793911.704501:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:9476:x1875685729663616:12345-0@lo:502: Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.704508:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788793911.704586:0:9476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9476:1875685729663616:0@lo:502: 00000040:00080000:2.0:1788793911.704605:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788793911.704786:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788793911.704811:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788793911.704820:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.704831:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793911.704841:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788793911.704843:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788793911.704846:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788793911.704869:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.704876:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.704894:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793911.704908:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663744:0@lo:101: 00000100:00100000:0.0:1788793911.704984:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.705006:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.705048:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663744 00000100:00100000:2.0:1788793911.705053:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663744 00000100:00100000:2.0:1788793911.705081:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788793911.705088:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729663744:12345-0@lo:101: 00010000:00010000:2.0:1788793911.705096:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793911.705108:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aa71 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.705257:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.705268:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.705277:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b61c00, rc 0) 00000100:00100000:2.0:1788793911.705318:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729663744:12345-0@lo:101: Request processed in 231us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.705324:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788793911.705381:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663744:0@lo:101: 00010000:00010000:0.0:1788793911.705393:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.705401:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793911.705455:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663872:0@lo:501: 00000100:00100000:0.0:1788793911.705477:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.705504:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.705619:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729663872 00000100:00100000:1.0:1788793911.705624:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729663872 00000100:00100000:1.0:1788793911.705653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788793911.705659:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729663872:12345-0@lo:501: 00000100:00100000:1.0:1788793911.705749:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729663872:12345-0@lo:501: Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.705755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788793911.705846:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729663872:0@lo:501: 00000100:00100000:0.0:1788793911.705868:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664000:0@lo:503: 00000100:00100000:0.0:1788793911.705897:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.705916:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.705975:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664000 00000100:00100000:1.0:1788793911.705979:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664000 00000100:00100000:1.0:1788793911.706003:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788793911.706009:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729664000:12345-0@lo:503: 00000100:00100000:1.0:1788793911.706076:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729664000:12345-0@lo:503: Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.706082:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788793911.706154:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664000:0@lo:503: 00000100:00100000:0.0:1788793911.706722:0:9477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9477:1875685729664128:0@lo:502: 00000100:00100000:0.0:1788793911.706754:0:9477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.706782:0:9477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.706822:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664128 00000100:00100000:2.0:1788793911.706827:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664128 00000100:00100000:2.0:1788793911.706865:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788793911.706872:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:9477:x1875685729664128:12345-0@lo:502: 00000100:00100000:2.0:1788793911.706961:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:9477:x1875685729664128:12345-0@lo:502: Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.706968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788793911.707087:0:9477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9477:1875685729664128:0@lo:502: 00000020:01000000:0.0:1788793911.707111:0:9477:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793911.707118:0:9477:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793911.707121:0:9477:0:(obd_config.c:1547:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788793911.707158:0:9477:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788793911.707176:0:9477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9477:1875685729664256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793911.707203:0:9477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.707217:0:9477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.707295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664256 00000100:00100000:2.0:1788793911.707299:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664256 00000100:00100000:2.0:1788793911.707326:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788793911.707333:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:9477:x1875685729664256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.707516:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:9477:x1875685729664256:12345-0@lo:502:llog_process_th.0 Request processed in 183us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.707523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788793911.707691:0:9477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9477:1875685729664256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793911.707709:0:9477:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793911.707713:0:9477:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793911.707715:0:9477:0:(obd_config.c:1547:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788793911.707718:0:9477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788793911.707864:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788793911.707881:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788793911.707889:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.707900:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793911.707909:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788793911.707911:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af501bb0000 from 39 10000000:01000000:0.0:1788793911.707914:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788793911.707983:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.707991:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793911.708000:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793911.708012:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793911.708035:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793911.708094:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.708179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664384 00000100:00100000:1.0:1788793911.708183:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664384 00000100:00100000:1.0:1788793911.708241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788793911.708248:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729664384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793911.708256:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793911.708271:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aa7f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.708356:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.708369:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.708377:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166b200, rc 0) 00000100:00100000:1.0:1788793911.708416:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729664384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.708421:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788793911.708482:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793911.708495:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.708510:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793911.708559:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.708585:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.708724:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793911.708792:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664512 00000100:00100000:0.0:1788793911.708796:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664512 00000100:00100000:0.0:1788793911.708815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788793911.708821:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729664512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793911.708928:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729664512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.708935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788793911.709000:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.709026:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.709061:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.709084:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793911.710664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664640 00000100:00100000:0.0:1788793911.710676:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664640 00000100:00100000:0.0:1788793911.710715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788793911.710723:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729664640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793911.710873:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729664640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.710879:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788793911.710972:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729664640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.712632:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9478:1875685729664768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.712693:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.714176:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.715640:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664768 00000100:00100000:3.0:1788793911.715655:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664768 00000100:00100000:3.0:1788793911.715767:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788793911.715778:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:9478:x1875685729664768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.715973:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:9478:x1875685729664768:12345-0@lo:502:llog_process_th.0 Request processed in 196us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.715981:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788793911.716080:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9478:1875685729664768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.716170:0:9478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9478:1875685729664896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.716211:0:9478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.718905:0:9478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4ce7cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793911.723690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729664896 00000100:00100000:0.0:1788793911.723709:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729664896 00000100:00100000:3.0:1788793911.723771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788793911.723788:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:9478:x1875685729664896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.723979:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:9478:x1875685729664896:12345-0@lo:502:llog_process_th.0 Request processed in 195us (7767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.724143:0:9478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9478:1875685729664896:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788793911.724180:0:9478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788793911.724518:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788793911.724541:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793911.724551:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.724562:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793911.724571:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788793911.724573:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788793911.724576:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788793911.724608:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.724616:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.724625:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793911.724650:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788793911.724685:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793911.724721:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.724755:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665024 00000100:00100000:2.0:1788793911.724759:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665024 00000100:00100000:3.0:1788793911.724818:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788793911.724856:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788793911.724872:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729665024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793911.724882:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793911.724893:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aa8d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.724913:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.724921:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.724930:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b60e00, rc 0) 00000100:00100000:2.0:1788793911.724971:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729665024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.724975:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788793911.725045:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793911.725055:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.725061:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793911.725099:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793911.725116:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.725155:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665152 00000100:00100000:1.0:1788793911.725164:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.725234:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665152 00000100:00100000:3.0:1788793911.725256:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788793911.725263:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729665152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.725367:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729665152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.725374:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788793911.725563:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793911.725591:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793911.725627:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793911.725684:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788793911.725715:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665280 00000100:00100000:0.0:1788793911.725719:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665280 00000100:00100000:0.0:1788793911.725777:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788793911.725785:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729665280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793911.725865:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729665280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.725872:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788793911.725930:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793911.726738:0:9479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9479:1875685729665408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793911.726777:0:9479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793911.726844:0:9479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.726874:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665408 00000100:00100000:3.0:1788793911.726879:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665408 00000100:00100000:3.0:1788793911.726939:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788793911.726948:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:9479:x1875685729665408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.727040:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:9479:x1875685729665408:12345-0@lo:502:llog_process_th.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.727047:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788793911.727110:0:9479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9479:1875685729665408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793911.727150:0:9479:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793911.727164:0:9479:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793911.727167:0:9479:0:(obd_config.c:1547:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788793911.727173:0:9479:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788793911.727193:0:9479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9479:1875685729665536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793911.727224:0:9479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793911.727586:0:9479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c57359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793911.727655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665536 00000100:00100000:2.0:1788793911.727660:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665536 00000100:00100000:2.0:1788793911.727690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788793911.727697:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:9479:x1875685729665536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.727783:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:9479:x1875685729665536:12345-0@lo:502:llog_process_th.0 Request processed in 86us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.727789:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788793911.727857:0:9479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9479:1875685729665536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793911.727877:0:9479:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793911.727881:0:9479:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793911.727883:0:9479:0:(obd_config.c:1547:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788793911.727887:0:9479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788793911.728018:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788793911.728047:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788793911.728057:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.728066:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793911.728081:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793911.728084:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4dfc78000 from 39 10000000:01000000:2.0:1788793911.728087:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793911.728110:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.728118:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.728154:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793911.728168:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.728196:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.728218:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.728418:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665664 00000100:00100000:1.0:1788793911.728423:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665664 00000100:00100000:1.0:1788793911.728517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788793911.728523:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729665664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793911.728532:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793911.728543:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aa9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.728563:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.728574:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793911.728583:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a400, rc 0) 00000100:00100000:1.0:1788793911.728618:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729665664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.728625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788793911.728689:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793911.728702:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793911.728712:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793911.728755:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.728778:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.728832:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.728876:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665792 00000100:00100000:3.0:1788793911.728880:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665792 00000100:00100000:0.0:1788793911.728941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788793911.728951:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729665792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793911.729047:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729665792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793911.729060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788793911.729164:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.729189:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.729225:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.729580:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.729631:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729665920 00000100:00100000:1.0:1788793911.729636:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729665920 00000100:00100000:1.0:1788793911.729660:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788793911.729666:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729665920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793911.729748:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729665920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.729755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788793911.729822:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729665920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793911.730570:0:9480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9480:1875685729666048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.730612:0:9480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793911.730683:0:9480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe4a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788793911.730711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666048 00000100:00100000:1.0:1788793911.730716:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666048 00000100:00100000:1.0:1788793911.730779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788793911.730788:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9480:x1875685729666048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793911.730872:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9480:x1875685729666048:12345-0@lo:502:llog_process_th.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.730879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788793911.730941:0:9480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9480:1875685729666048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.730979:0:9480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9480:1875685729666176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793911.731027:0:9480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.731694:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666176 00000100:00100000:3.0:1788793911.731700:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666176 00000100:00100000:3.0:1788793911.731723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788793911.731729:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9480:x1875685729666176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.731803:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9480:x1875685729666176:12345-0@lo:502:llog_process_th.0 Request processed in 73us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.731810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788793911.731858:0:9480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d3f3ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.731871:0:9480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9480:1875685729666176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788793911.731892:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788793911.731957:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788793911.731993:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788793911.732003:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732013:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793911.732023:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788793911.732026:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788793911.732029:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788793911.732051:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732059:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732068:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793911.732081:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.732107:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.732120:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.732150:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666304 00000100:00100000:3.0:1788793911.732154:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666304 00000100:00100000:3.0:1788793911.732170:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788793911.732175:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729666304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793911.732183:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793911.732193:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aaa9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732224:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732234:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732243:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0000, rc 0) 00000100:00100000:3.0:1788793911.732283:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729666304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.732576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788793911.732602:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793911.732614:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.732623:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793911.732665:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.732687:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.732696:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.732712:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666432 00000100:00100000:3.0:1788793911.732715:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666432 00000100:00100000:3.0:1788793911.732731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788793911.732737:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729666432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.732821:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729666432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.732837:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788793911.732859:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.732882:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.732913:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.732921:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.732937:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666560 00000100:00100000:3.0:1788793911.732940:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666560 00000100:00100000:3.0:1788793911.732956:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788793911.732961:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729666560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.733115:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729666560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.733141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788793911.733169:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.734687:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9481:1875685729666688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.734750:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.734783:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666688 00000100:00100000:3.0:1788793911.734789:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666688 00000100:00100000:3.0:1788793911.734815:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788793911.734822:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9481:x1875685729666688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.734920:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9481:x1875685729666688:12345-0@lo:502:llog_process_th.0 Request processed in 98us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.734928:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788793911.734966:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.734996:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9481:1875685729666688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793911.735027:0:9481:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788793911.735036:0:9481:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793911.735038:0:9481:0:(obd_config.c:1547:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788793911.735043:0:9481:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788793911.735064:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9481:1875685729666816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.735094:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.735142:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666816 00000100:00100000:3.0:1788793911.735146:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666816 00000100:00100000:3.0:1788793911.735254:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788793911.735260:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9481:x1875685729666816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793911.735318:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9481:x1875685729666816:12345-0@lo:502:llog_process_th.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.735325:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788793911.735354:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.735367:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9481:1875685729666816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793911.735384:0:9481:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788793911.735388:0:9481:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793911.735390:0:9481:0:(obd_config.c:1547:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788793911.735393:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788793911.735452:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788793911.735470:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788793911.735479:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735490:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793911.735501:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788793911.735509:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af4ce6799e8 from 1 10000000:01000000:3.0:1788793911.735512:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788793911.735533:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735541:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735550:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793911.735562:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.735586:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.735600:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.735613:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729666944 00000100:00100000:3.0:1788793911.735616:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729666944 00000100:00100000:3.0:1788793911.735633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788793911.735639:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729666944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793911.735647:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793911.735657:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aab7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735676:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735685:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735693:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d1c00, rc 0) 00000100:00100000:3.0:1788793911.735719:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729666944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.735731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788793911.735763:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729666944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793911.735775:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.735783:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793911.735824:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729667072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.735847:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793911.735859:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793911.735869:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667072 00000100:00100000:3.0:1788793911.735872:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667072 00000100:00100000:3.0:1788793911.735887:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788793911.735893:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729667072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793911.735950:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729667072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (102us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788793911.735956:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788793911.735982:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729667072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788793911.735999:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788793911.736003:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793911.736010:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793911.746502:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793911.746541:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793911.746572:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793911.746645:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616896 00000100:00100000:2.0:1788793911.746654:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616896 00000100:00100000:2.0:1788793911.746707:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1788793911.746727:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707616896:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1788793911.746799:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707616896:12345-192.168.201.8@tcp:400: Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.746807:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00080000:2.0:1788793911.746827:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788793911.746958:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793911.747007:0:7516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617024 00000100:00100000:2.0:1788793911.747010:0:7516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617024 00000100:00100000:2.0:1788793911.747040:0:7516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:2.0:1788793911.747047:0:7516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707617024:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1788793911.747071:0:7516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707617024:12345-192.168.201.8@tcp:400: Request processed in 26us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793911.747075:0:7516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:3.0:1788793911.747292:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616640 00000100:00100000:3.0:1788793911.747296:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616640 00000100:00100000:3.0:1788793911.747323:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00100000:3.0:1788793911.747327:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+8:2371:x1875685707616640:12345-192.168.201.8@tcp:400: 00000100:00100000:3.0:1788793911.747395:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+8:2371:x1875685707616640:12345-192.168.201.8@tcp:400: Request processed in 67us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793911.747400:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00080000:0.0:1788793911.747620:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788793911.747770:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707616768 00000100:00100000:1.0:1788793911.747775:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707616768 00000100:00100000:1.0:1788793911.747869:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1788793911.747878:0:9223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2371:x1875685707616768:12345-192.168.201.8@tcp:400: 00000100:00100000:1.0:1788793911.747922:0:9223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2371:x1875685707616768:12345-192.168.201.8@tcp:400: Request processed in 47us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793911.747930:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00080000:0.0:1788793911.748414:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788793912.651518:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793912.651734:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729667328:0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.651801:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729667456:0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.651867:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793912.651927:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729667968:0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.651952:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793912.651982:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788793912.651987:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729667584:0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.652008:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793912.652038:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667456 00000100:00100000:0.0:1788793912.652046:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667456 00000100:00100000:0.0:1788793912.652086:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667584 00000100:00100000:0.0:1788793912.652089:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667584 00000100:00100000:0.0:1788793912.652121:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788793912.652153:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729667456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.652228:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1875685729667456:12345-0@lo:400:kworker.0 Request processed in 76us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793912.652236:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788793912.652257:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788793912.652265:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729667584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793912.652285:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793912.652307:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729667584:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793912.652333:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788793912.652356:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729667840:0@lo:400:kworker.0 00000100:00080000:0.0:1788793912.652364:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788793912.652410:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729667584:0@lo:400:kworker.0 00000100:00100000:1.0:1788793912.652410:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793912.652450:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3461:1875685729667456:0@lo:400:kworker.0 00000100:00100000:1.0:1788793912.652465:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788793912.652490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667328 00000100:00100000:1.0:1788793912.652490:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729667200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788793912.652499:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667328 00000100:00100000:1.0:1788793912.652535:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793912.652540:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788793912.652549:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729667328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793912.652567:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729667712:0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.652601:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729667328:12345-0@lo:400:kworker.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793912.652609:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788793912.652619:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793912.652664:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729667328:0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.652671:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667840 00000100:00100000:0.0:1788793912.652678:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667840 00000100:00100000:1.0:1788793912.652708:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667200 00000100:00100000:1.0:1788793912.652716:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667200 00000100:00100000:0.0:1788793912.652737:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788793912.652748:0:9223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729667840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788793912.652797:0:9223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3464:x1875685729667840:12345-0@lo:400:kworker.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793912.652803:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788793912.652820:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788793912.652823:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788793912.652862:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3464:1875685729667840:0@lo:400:kworker.0 00000100:00100000:2.0:1788793912.652975:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667968 00000100:00100000:2.0:1788793912.652981:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667968 00000100:00100000:2.0:1788793912.653035:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729667712 00000100:00100000:2.0:1788793912.653039:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729667712 00000100:00100000:3.0:1788793912.653061:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788793912.653078:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3461:x1875685729667968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793912.653086:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788793912.653100:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729667712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788793912.653197:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3461:x1875685729667968:12345-0@lo:400:kworker.0 Request processed in 123us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793912.653208:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729667712:12345-0@lo:400:kworker.0 Request processed in 111us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793912.653209:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788793912.653223:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788793912.653256:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793912.653269:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f78d5c00 x1875685729667968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788793912.653287:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f78d6d80 x1875685729667712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793912.653287:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729667968:0@lo:400:kworker.0 00000100:00100000:2.0:1788793912.653314:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729667712:0@lo:400:kworker.0 00000100:00100000:1.0:1788793912.654736:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788793912.654758:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729667200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788793912.654979:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788793912.655162:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729667200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 414us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793912.655170:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788793912.655517:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7791f80 x1875685729667200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793912.655543:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729667200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788793913.283055:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793913.286447:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617152 00000100:00100000:1.0:1788793913.286472:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617152 00000100:00100000:1.0:1788793913.286776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 169 00000100:00100000:1.0:1788793913.286786:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+8:6849:x1875685707617152:12345-192.168.201.8@tcp:101: 00010000:00010000:1.0:1788793913.286947:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793913.286972:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c47 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793913.287011:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793913.287024:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793913.287057:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166b400, rc 0) 00000100:00100000:1.0:1788793913.287288:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707617152:12345-192.168.201.8@tcp:101: Request processed in 502us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793913.287296:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 169 00000100:00100000:2.0:1788793913.299735:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793913.301273:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617280 00000100:00100000:3.0:1788793913.301288:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617280 00000100:00100000:2.0:1788793913.301624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 170 00000100:00100000:2.0:1788793913.301650:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707617280:12345-192.168.201.8@tcp:501: 00000100:00100000:2.0:1788793913.301854:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707617280:12345-192.168.201.8@tcp:501: Request processed in 218us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793913.301862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 170 00000100:00100000:2.0:1788793913.310648:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793913.310800:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617408 00000100:00100000:1.0:1788793913.310810:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617408 00000100:00100000:1.0:1788793913.310871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:1.0:1788793913.310882:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707617408:12345-192.168.201.8@tcp:503: 00000100:00100000:1.0:1788793913.311031:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707617408:12345-192.168.201.8@tcp:503: Request processed in 150us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793913.311039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:2.0:1788793913.316261:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793913.316363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617536 00000100:00100000:3.0:1788793913.316374:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617536 00000100:00100000:3.0:1788793913.316511:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:3.0:1788793913.316521:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:7334:x1875685707617536:12345-192.168.201.8@tcp:502: 00000100:00100000:3.0:1788793913.316672:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:7334:x1875685707617536:12345-192.168.201.8@tcp:502: Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793913.316680:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:0.0:1788793913.327931:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793913.328203:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617664 00000100:00100000:2.0:1788793913.328213:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617664 00000100:00100000:2.0:1788793913.328280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 173 00000100:00100000:2.0:1788793913.328292:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:7334:x1875685707617664:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788793913.328471:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:7334:x1875685707617664:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 182us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793913.328500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 173 00000100:00100000:2.0:1788793913.344318:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793913.344881:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617792 00000100:00100000:1.0:1788793913.344893:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617792 00000100:00100000:1.0:1788793913.344960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 174 00000100:00100000:1.0:1788793913.344971:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707617792:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793913.344987:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793913.345005:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c4e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793913.345034:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793913.345046:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793913.345056:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a000, rc 0) 00000100:00100000:1.0:1788793913.345380:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707617792:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 409us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793913.345388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 174 00000100:00100000:3.0:1788793913.347931:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793913.348034:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707617920 00000100:00100000:2.0:1788793913.348048:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707617920 00000100:00100000:2.0:1788793913.348827:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 175 00000100:00100000:2.0:1788793913.348842:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707617920:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793913.349024:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707617920:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 186us (1116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788793913.349032:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 175 00010000:00010000:1.0:1788793913.677878:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793914.699592:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793914.700172:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793914.700207:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729668096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788793914.700303:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793914.701501:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668096 00000100:00100000:2.0:1788793914.701516:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668096 00000100:00100000:2.0:1788793914.701613:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788793914.701628:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729668096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788793914.701659:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788793914.701743:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729668096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793914.701751:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788793914.701806:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4fabf1180 x1875685729668096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793914.701827:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729668096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788793914.703005:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788793914.740092:0:9518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9fe516d0 20000000:00000080:2.0:1788793914.740111:0:9518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af4f77ca000 uarg=0000000000000000 20000000:01000000:2.0:1788793914.740426:0:9518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788793914.740432:0:9518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788793914.740443:0:9518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788793914.740886:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788793914.741040:0:9518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788793914.745027:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788793914.745066:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788793914.745082:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788793914.745098:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788793914.745116:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745166:0:9518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a841 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745174:0:9518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745181:0:9518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33a96e expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745190:0:9518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745197:0:9518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745253:0:9518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745269:0:9518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 9 pid: 6522 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.745283:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668224:192.168.201.8@tcp:104: 00010000:00010000:3.0:1788793914.745447:0:9518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a96e expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745456:0:9518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a96e expref: 18 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.745465:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668352:0@lo:104: 00000100:00100000:3.0:1788793914.745506:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788793914.745543:0:9518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745552:0:9518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 18 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.745560:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668480:0@lo:104: 00000100:00100000:3.0:1788793914.745582:0:9518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788793914.745607:0:9518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33a841 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793914.745614:0:9518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33a841 expref: 18 pid: 6522 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.745635:0:9518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668608:0@lo:104: 00000100:00100000:3.0:1788793914.745656:0:9518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788793914.745769:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788793914.745788:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793914.745800:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668352 00000100:00100000:1.0:1788793914.745808:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668352 00000100:00100000:1.0:1788793914.745844:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668480 00000100:00100000:1.0:1788793914.745847:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668480 00000100:00100000:1.0:1788793914.745857:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668608 00000100:00100000:1.0:1788793914.745859:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668608 00000100:00100000:1.0:1788793914.745869:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788793914.745877:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9518:x1875685729668352:12345-0@lo:104: 00010000:00010000:1.0:1788793914.745889:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.745937:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793914.745943:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9518:x1875685729668352:12345-0@lo:104: Request processed in 67us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.745950:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788793914.745966:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788793914.745971:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f75ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9518:x1875685729668480:12345-0@lo:104: 00010000:00010000:1.0:1788793914.745978:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746009:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788793914.746014:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f75ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9518:x1875685729668480:12345-0@lo:104: Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.746026:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788793914.746054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788793914.746061:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f7790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9518:x1875685729668608:12345-0@lo:104: 00010000:00010000:1.0:1788793914.746068:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746100:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788793914.746105:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f7790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9518:x1875685729668608:12345-0@lo:104: Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.746110:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788793914.746143:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788793914.746150:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746156:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166ba00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793914.746160:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746168:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793914.746175:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793914.746180:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788793914.746206:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746213:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793914.746239:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746245:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166ba00/0x962a5e377b33a96e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a975 expref: -99 pid: 8585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746258:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788793914.746261:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746266:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d1600 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793914.746269:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746275:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793914.746281:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793914.746286:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788793914.746297:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746303:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793914.746308:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746314:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1600/0x962a5e377b33a8a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a8aa expref: -99 pid: 7510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746323:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793914.746330:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746337:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1513a00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793914.746340:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746347:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793914.746354:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793914.746359:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788793914.746372:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746377:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793914.746402:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746410:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1513a00/0x962a5e377b33a841 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33a848 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746423:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793914.746424:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793914.746426:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793914.746432:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793914.746443:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729668736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793914.746470:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793914.746493:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788793914.746506:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729668864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793914.746532:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793914.746562:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788793914.746570:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729668992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793914.746593:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793914.746620:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668736 00000100:00100000:1.0:1788793914.746624:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668736 00010000:00010000:1.0:1788793914.746642:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a96e expref: 19 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793914.746659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668864 00000100:00100000:1.0:1788793914.746662:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668864 00010000:00010000:1.0:1788793914.746673:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 20 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793914.746682:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729668992 00000100:00100000:1.0:1788793914.746684:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729668992 00010000:00010000:1.0:1788793914.746693:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a841 expref: 21 pid: 6522 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793914.746704:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788793914.746709:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+21:3463:x1875685729668736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793914.746720:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793914.746725:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a96e expref: 21 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746733:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a96e expref: 21 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746747:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793914.746781:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+21:3463:x1875685729668736:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.746787:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788793914.746799:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788793914.746804:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af501aace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3463:x1875685729668864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793914.746811:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793914.746815:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 20 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746823:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 20 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746831:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793914.746850:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af501aace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3463:x1875685729668864:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.746856:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788793914.746865:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788793914.746872:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3462:x1875685729668992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793914.746879:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793914.746883:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33a841 expref: 19 pid: 6522 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746891:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33a841 expref: 19 pid: 6522 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.746900:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793914.746924:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3462:x1875685729668992:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.746931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788793914.746972:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729668992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793914.746996:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729668864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793914.747003:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729668736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788793914.747103:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793914.747457:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1512200/0x962a5e377b33a975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a96e expref: 18 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.747470:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668352:0@lo:104: 00010000:00010000:3.0:1788793914.747480:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1512600/0x962a5e377b33a8aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a8a3 expref: 17 pid: 6523 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.747488:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668480:0@lo:104: 00010000:00010000:3.0:1788793914.747497:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c0031e00/0x962a5e377b33a848 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33a841 expref: 16 pid: 6522 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793914.747506:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668608:0@lo:104: 00000100:00100000:0.0:1788793914.750990:0:9518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9518:1875685729668224:192.168.201.8@tcp:104: 00010000:00010000:0.0:1788793914.751032:0:9518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793914.751517:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793914.751725:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618048 00000100:00100000:1.0:1788793914.751733:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618048 00010000:00010000:1.0:1788793914.751782:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 10 pid: 6522 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793914.751823:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:1.0:1788793914.751832:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2abe3cab-b632-4e65-86e0-311de8a706de+10:2370:x1875685707618048:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788793914.751848:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793914.751855:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 10 pid: 6522 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751867:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 10 pid: 6522 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751885:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af501b60a00/0x962a5e377b33aa32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c16 expref: 10 pid: 6522 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751901:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751909:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751924:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751943:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751950:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751957:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751965:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d1e00 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:1.0:1788793914.751969:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751978:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.751998:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793914.752010:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793914.752063:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2abe3cab-b632-4e65-86e0-311de8a706de+9:2370:x1875685707618048:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 232us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793914.752072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00010000:00010000:0.0:1788793914.752525:0:9518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793914.752535:0:9518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793914.752542:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33aad3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793915.250663:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793915.250748:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618176 00000100:00100000:2.0:1788793915.250758:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618176 00000100:00100000:2.0:1788793915.250824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00100000:2.0:1788793915.250836:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707618176:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793915.250853:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793915.250873:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b61400/0x962a5e377b33aada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c55 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793915.250903:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b61400/0x962a5e377b33aada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c55 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793915.250914:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b61400/0x962a5e377b33aada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c55 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793915.250924:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b61400, rc 0) 00000100:00100000:2.0:1788793915.250984:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707618176:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 150us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793915.250991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00100000:3.0:1788793915.253336:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793915.253441:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618304 00000100:00100000:2.0:1788793915.253451:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618304 00000100:00100000:2.0:1788793915.253510:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 177 00000100:00100000:2.0:1788793915.253521:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707618304:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793915.253660:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707618304:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 142us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793915.253668:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 177 00000100:00100000:2.0:1788793915.271704:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793915.275157:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618432 00000100:00100000:1.0:1788793915.275173:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618432 00000100:00100000:1.0:1788793915.275235:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 178 00000100:00100000:1.0:1788793915.275245:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707618432:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793915.275404:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707618432:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 160us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793915.275419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 178 00000100:00100000:3.0:1788793915.282808:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793915.282896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618560 00000100:00100000:0.0:1788793915.282908:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618560 00000100:00100000:0.0:1788793915.282964:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 179 00000100:00100000:0.0:1788793915.282975:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:7391:x1875685707618560:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788793915.283178:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:7391:x1875685707618560:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 204us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793915.283186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 179 00000100:00100000:1.0:1788793915.293593:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793915.293727:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618688 00000100:00100000:1.0:1788793915.293737:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618688 00000100:00100000:1.0:1788793915.293794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 180 00000100:00100000:1.0:1788793915.293805:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:7391:x1875685707618688:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788793915.293952:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:7391:x1875685707618688:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 149us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793915.293960:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 180 00010000:00010000:1.0:1788793915.723847:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788793916.043408:0:6526:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788793916.043414:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af4fa80f000 from 4 10000000:01000000:0.0:1788793916.043418:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788793916.043461:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793916.043473:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793916.043484:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793916.043520:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793916.043589:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793916.043944:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d8743180 going to sleep for 11 seconds 00000100:00100000:1.0:1788793916.051697:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669120 00000100:00100000:1.0:1788793916.051713:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669120 00000100:00100000:1.0:1788793916.051784:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788793916.051796:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729669120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793916.051812:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793916.051832:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166a800/0x962a5e377b33aae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aae1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793916.051861:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166a800/0x962a5e377b33aae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aae1 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793916.051872:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166a800/0x962a5e377b33aae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aae1 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793916.051880:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166a800, rc 0) 00000100:00100000:1.0:1788793916.051963:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729669120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (8374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793916.051981:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788793916.052354:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793916.052384:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aae8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.052393:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aae8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793916.052465:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.052500:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.052546:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788793916.052705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669248 00000100:00100000:1.0:1788793916.052710:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669248 00000100:00100000:1.0:1788793916.052742:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788793916.052758:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729669248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793916.052870:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729669248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793916.052877:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788793916.052989:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.053017:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.053058:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.053081:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788793916.053094:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669376 00000100:00100000:3.0:1788793916.053098:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669376 00000100:00100000:3.0:1788793916.053116:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788793916.053151:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729669376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.053242:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729669376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.053250:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788793916.053282:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.053725:0:9579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9579:1875685729669504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793916.053761:0:9579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.053782:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669504 00000100:00100000:3.0:1788793916.053786:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669504 00000100:00100000:3.0:1788793916.053805:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788793916.053811:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9579:x1875685729669504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793916.053879:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9579:x1875685729669504:12345-0@lo:502:llog_process_th.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.053885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788793916.053921:0:9579:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793916.053933:0:9579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9579:1875685729669504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793916.053953:0:9579:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788793916.053967:0:9579:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793916.053969:0:9579:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788793916.053976:0:9579:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af4fa80f000 00000020:00000080:3.0:1788793916.053978:0:9579:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788793916.054034:0:9579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9579:1875685729669632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793916.054065:0:9579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.054084:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669632 00000100:00100000:3.0:1788793916.054087:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669632 00000100:00100000:3.0:1788793916.054104:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788793916.054109:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9579:x1875685729669632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793916.054188:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:9579:x1875685729669632:12345-0@lo:502:llog_process_th.0 Request processed in 77us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.054194:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788793916.054223:0:9579:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe69d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793916.054234:0:9579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9579:1875685729669632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793916.054251:0:9579:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788793916.054255:0:9579:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793916.054256:0:9579:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788793916.054259:0:9579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788793916.054301:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788793916.054315:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788793916.054324:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aae8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.054333:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b400/0x962a5e377b33aae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aae8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793916.054464:0:6526:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788793916.054467:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af501bb0000 from 4 10000000:01000000:3.0:1788793916.054476:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788793916.054497:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.054505:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.054514:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793916.054526:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.054552:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.054569:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793916.055731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669760 00000100:00100000:3.0:1788793916.055740:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669760 00000100:00100000:3.0:1788793916.055775:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788793916.055782:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729669760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793916.055794:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793916.055807:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33aaf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aaef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.055829:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33aaf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aaef expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.055838:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0c00/0x962a5e377b33aaf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aaef expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.055846:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0c00, rc 0) 00000100:00100000:3.0:1788793916.055896:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729669760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.055911:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788793916.055957:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793916.055975:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aaf6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.055985:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33aaf6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793916.056045:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.056072:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.056097:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793916.056109:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729669888 00000100:00100000:3.0:1788793916.056113:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729669888 00000100:00100000:3.0:1788793916.056154:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788793916.056160:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729669888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.056251:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729669888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.056258:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788793916.056284:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729669888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.056307:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793916.056342:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793916.056642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670016 00000100:00100000:2.0:1788793916.056647:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670016 00000100:00100000:2.0:1788793916.056683:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788793916.056693:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729670016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.056768:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729670016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793916.056774:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788793916.059392:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4d9385600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793916.059428:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793916.061380:0:9582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9582:1875685729670144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793916.061459:0:9582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793916.066245:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670144 00000100:00100000:3.0:1788793916.066276:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670144 00000100:00100000:3.0:1788793916.066336:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788793916.066346:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9582:x1875685729670144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793916.066511:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9582:x1875685729670144:12345-0@lo:502:llog_process_th.0 Request processed in 166us (5052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.066519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788793916.073862:0:9582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788793916.073908:0:9582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9582:1875685729670144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793916.073951:0:9582:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793916.073963:0:9582:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793916.073965:0:9582:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788793916.073972:0:9582:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af501bb0000 00000020:00000080:1.0:1788793916.073974:0:9582:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788793916.074072:0:9582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9582:1875685729670272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793916.074166:0:9582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793916.074269:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670272 00000100:00100000:1.0:1788793916.074277:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670272 00000100:00100000:1.0:1788793916.074323:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788793916.074332:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9582:x1875685729670272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793916.074448:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:9582:x1875685729670272:12345-0@lo:502:llog_process_th.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793916.074465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788793916.074507:0:9582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788793916.074520:0:9582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9582:1875685729670272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793916.074537:0:9582:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793916.074541:0:9582:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793916.074542:0:9582:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788793916.074545:0:9582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788793916.076178:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788793916.076273:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788793916.076286:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aaf6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076298:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c29d1a00/0x962a5e377b33aaef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33aaf6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793916.076309:0:6526:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788793916.076311:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9af4dfc78000 from 4 10000000:01000000:2.0:1788793916.076314:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788793916.076347:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076355:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076373:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793916.076396:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.076451:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793916.076488:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793916.076514:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670400 00000100:00100000:2.0:1788793916.076519:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670400 00000100:00100000:2.0:1788793916.076571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788793916.076581:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729670400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793916.076593:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793916.076608:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b61a00/0x962a5e377b33ab04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aafd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076630:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b61a00/0x962a5e377b33ab04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aafd expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076640:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b61a00/0x962a5e377b33ab04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aafd expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076649:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b61a00, rc 0) 00000100:00100000:2.0:1788793916.076684:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729670400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793916.076690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788793916.076730:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793916.076744:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab04 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793916.076752:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab04 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793916.076803:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.076828:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793916.076854:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793916.076867:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670528 00000100:00100000:2.0:1788793916.076871:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670528 00000100:00100000:2.0:1788793916.076895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788793916.076902:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729670528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.076999:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729670528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793916.077006:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788793916.077035:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.077060:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.077096:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793916.077110:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793916.077145:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670656 00000100:00100000:2.0:1788793916.077149:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670656 00000100:00100000:2.0:1788793916.077175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788793916.077183:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729670656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793916.080707:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729670656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3517us (3602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793916.080721:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788793916.083254:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729670656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793916.088730:0:9584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9584:1875685729670784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793916.088809:0:9584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793916.088847:0:9584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c7e1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793916.089720:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670784 00000100:00100000:2.0:1788793916.089729:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670784 00000100:00100000:2.0:1788793916.089790:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788793916.089803:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9584:x1875685729670784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793916.089941:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9584:x1875685729670784:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793916.089949:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788793916.093548:0:9584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9584:1875685729670784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788793916.093591:0:9584:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793916.093600:0:9584:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793916.093602:0:9584:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788793916.093611:0:9584:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9af4dfc78000 00000020:00000080:0.0:1788793916.093613:0:9584:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788793916.093714:0:9584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9584:1875685729670912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793916.093779:0:9584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793916.093820:0:9584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c7e1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793916.100972:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729670912 00000100:00100000:2.0:1788793916.100985:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729670912 00000100:00100000:2.0:1788793916.101086:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788793916.101096:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9584:x1875685729670912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793916.101266:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9584:x1875685729670912:12345-0@lo:502:llog_process_th.0 Request processed in 171us (7486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793916.101273:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788793916.101369:0:9584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9584:1875685729670912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788793916.101398:0:9584:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788793916.101405:0:9584:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793916.101407:0:9584:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788793916.101412:0:9584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788793916.101469:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788793916.101492:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788793916.101502:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab04 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793916.101524:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b60800/0x962a5e377b33aafd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab04 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793916.749833:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793916.867786:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793916.867843:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793916.867882:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793916.867904:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793916.867937:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619200 00000100:00100000:3.0:1788793916.867947:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619200 00000100:00100000:3.0:1788793916.868017:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619072 00000100:00100000:3.0:1788793916.868021:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619072 00000100:00100000:3.0:1788793916.868048:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:3.0:1788793916.868057:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707619200:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1788793916.868153:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707619200:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793916.868160:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:0.0:1788793916.868442:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618944 00000100:00100000:0.0:1788793916.868447:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618944 00000100:00100000:0.0:1788793916.868495:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:0.0:1788793916.868504:0:9223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2371:x1875685707618944:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1788793916.868536:0:9223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a13e557-9164-462f-8696-12fb9eb0378a+6:2371:x1875685707618944:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793916.868542:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:0.0:1788793916.868564:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707618816 00000100:00100000:0.0:1788793916.868567:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707618816 00000100:00100000:0.0:1788793916.868593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 196 00000100:00100000:0.0:1788793916.868599:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707618816:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1788793916.868624:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707618816:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793916.868630:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 196 00000100:00100000:1.0:1788793916.868837:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:1.0:1788793916.868847:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707619072:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1788793916.868875:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2371:x1875685707619072:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 32us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793916.868882:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00080000:3.0:1788793916.868920:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788793916.868925:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788793916.868927:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788793917.771493:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729671040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788793917.771579:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793917.771708:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729671040 00000100:00100000:1.0:1788793917.771717:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729671040 00000100:00100000:1.0:1788793917.771785:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788793917.771795:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729671040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788793917.771822:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788793917.771872:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729671040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793917.771884:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788793917.771925:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce61c000 x1875685729671040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793917.771944:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729671040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788793917.772313:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793917.772462:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729671168:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772512:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793917.772539:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1875685729671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772562:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793917.772581:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788793917.772585:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772603:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793917.772631:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729671424:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772654:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793917.772673:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788793917.772678:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772714:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793917.772744:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729671168 00000100:00100000:1.0:1788793917.772748:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729671168 00000100:00100000:1.0:1788793917.772781:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788793917.772789:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3463:x1875685729671168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772828:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3463:x1875685729671168:12345-0@lo:400:kworker.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793917.772835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788793917.772863:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729671680 00000100:00100000:1.0:1788793917.772867:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729671680 00000100:00100000:1.0:1788793917.772892:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729671296 00000100:00100000:1.0:1788793917.772895:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729671296 00000100:00100000:1.0:1788793917.772908:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729671424 00000100:00100000:1.0:1788793917.772910:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729671424 00000100:00100000:1.0:1788793917.772924:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788793917.772930:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1875685729671680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.772961:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3463:x1875685729671680:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793917.772974:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788793917.772986:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788793917.773059:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773088:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3463:x1875685729671296:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793917.773095:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788793917.773106:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788793917.773112:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c4812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729671424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773256:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c4812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1875685729671424:12345-0@lo:400:kworker.0 Request processed in 144us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793917.773263:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788793917.773288:0:7517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729671552 00000100:00100000:1.0:1788793917.773291:0:7517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729671552 00000100:00100000:1.0:1788793917.773342:0:7517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788793917.773350:0:7517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729671552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773377:0:7517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729671552:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793917.773383:0:7517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788793917.773422:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f7793100 x1875685729671552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793917.773433:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773444:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3461:1875685729671424:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773470:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3463:1875685729671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773478:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3463:1875685729671168:0@lo:400:kworker.0 00000100:00100000:1.0:1788793917.773496:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3463:1875685729671680:0@lo:400:kworker.0 00000100:00080000:3.0:1788793917.774109:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788793917.774157:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788793917.774161:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1788793918.443428:0:9671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=ski 00010000:00010000:1.0:1788793918.797277:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788793919.386850:0:9719:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8bd3d660 20000000:00000080:2.0:1788793919.386869:0:9719:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af4f77cb400 uarg=0000000000000000 20000000:01000000:2.0:1788793919.386913:0:9719:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788793919.386916:0:9719:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788793919.386919:0:9719:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='srpc.flavor.default.cli2mdt=ski' 20000000:01000000:2.0:1788793919.386923:0:9719:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'srpc.flavor.default.cli2mdt=ski' 00000040:00080000:2.0:1788793919.387443:0:9719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788793919.387457:0:9719:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-sptlrpc/lustre/srpc.flavor.default.cli2mdt fl=4 00000040:00080000:2.0:1788793919.387491:0:9719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793919.387502:0:9719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793919.387764:0:9719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788793919.387796:0:9719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 104 off8520 00000040:00080000:2.0:1788793919.387816:0:9719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8744 10000000:01000000:2.0:1788793919.387832:0:9719:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788793919.387852:0:9719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387872:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387881:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387888:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387902:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387909:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387915:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387922:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387932:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387939:0:9719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387948:0:9719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.387986:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.388645:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 9 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.388669:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729671808:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793919.388803:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.388821:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 9 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.388830:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729671936:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793919.388864:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.388872:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 18 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.388894:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672064:0@lo:104: 00000100:00100000:2.0:1788793919.388934:0:9719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793919.388974:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.388983:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 18 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.388990:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672192:0@lo:104: 00000100:00100000:2.0:1788793919.389011:0:9719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793919.389053:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.389061:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 18 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.389069:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672320:0@lo:104: 00000100:00100000:2.0:1788793919.389089:0:9719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793919.390405:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.390419:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 18 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.390430:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672448:0@lo:104: 00000100:00100000:2.0:1788793919.390468:0:9719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793919.390486:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.390494:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 18 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.390502:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672576:0@lo:104: 00000100:00100000:2.0:1788793919.390536:0:9719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793919.390554:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.390562:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 18 pid: 6523 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.390570:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672704:0@lo:104: 00000100:00100000:2.0:1788793919.390594:0:9719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793919.390610:0:9719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.390617:0:9719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 18 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.390625:0:9719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672832:0@lo:104: 00000100:00100000:2.0:1788793919.390658:0:9719:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793919.392008:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788793919.392043:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793919.392063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672064 00000100:00100000:0.0:1788793919.392072:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672064 00000100:00100000:0.0:1788793919.392113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672192 00000100:00100000:0.0:1788793919.392117:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672192 00000100:00100000:0.0:1788793919.392152:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672320 00000100:00100000:0.0:1788793919.392155:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672320 00000100:00100000:0.0:1788793919.392179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672448 00000100:00100000:0.0:1788793919.392182:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672448 00000100:00100000:0.0:1788793919.392190:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672576 00000100:00100000:0.0:1788793919.392192:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672576 00000100:00100000:0.0:1788793919.392199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672704 00000100:00100000:0.0:1788793919.392201:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672704 00000100:00100000:0.0:1788793919.392210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672832 00000100:00100000:0.0:1788793919.392212:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672832 00000100:00100000:0.0:1788793919.392224:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788793919.392233:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:9719:x1875685729672064:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392247:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.392324:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793919.392330:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+9:9719:x1875685729672064:12345-0@lo:104: Request processed in 99us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.392337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788793919.392355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788793919.392361:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+8:9719:x1875685729672192:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392369:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.392405:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788793919.392410:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+8:9719:x1875685729672192:12345-0@lo:104: Request processed in 50us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.392416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788793919.392427:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788793919.392433:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+7:9719:x1875685729672320:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392439:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.392481:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788793919.392487:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+7:9719:x1875685729672320:12345-0@lo:104: Request processed in 55us (3398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.392493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788793919.392505:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793919.392523:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+6:9719:x1875685729672448:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392531:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.392558:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788793919.392563:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+6:9719:x1875685729672448:12345-0@lo:104: Request processed in 53us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.392569:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793919.392580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788793919.392586:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9719:x1875685729672576:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392593:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.392621:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788793919.392626:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9719:x1875685729672576:12345-0@lo:104: Request processed in 41us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.392631:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788793919.392642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788793919.392647:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fa8f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9719:x1875685729672704:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392654:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.392688:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788793919.392693:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fa8f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9719:x1875685729672704:12345-0@lo:104: Request processed in 46us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.392698:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788793919.392731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788793919.392737:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9719:x1875685729672832:12345-0@lo:104: 00010000:00010000:0.0:1788793919.392744:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.393048:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672064:0@lo:104: 00000100:00100000:2.0:1788793919.393058:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672192:0@lo:104: 00000100:00100000:2.0:1788793919.393065:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672320:0@lo:104: 00000100:00100000:2.0:1788793919.393073:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672448:0@lo:104: 00000100:00100000:2.0:1788793919.393079:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672576:0@lo:104: 00000100:00100000:2.0:1788793919.393085:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672704:0@lo:104: 00010000:00010000:1.0:1788793919.394191:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788793919.394202:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394212:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d0e00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793919.394216:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394226:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793919.394234:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793919.394240:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793919.394296:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394312:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793919.394334:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394341:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0e00/0x962a5e377b33aab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aabe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394357:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788793919.394360:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394381:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c29d0800 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793919.394384:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394392:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793919.394398:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793919.394403:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793919.394417:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394424:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793919.394438:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394445:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c29d0800/0x962a5e377b33aaa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aab0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394455:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788793919.394458:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394463:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af501b61e00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793919.394465:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394482:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793919.394488:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793919.394493:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793919.394508:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394591:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793919.394600:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394606:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33aa9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aaa2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394614:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788793919.394618:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394623:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166b000 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793919.394626:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394633:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793919.394639:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793919.394650:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793919.394668:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394673:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793919.394678:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394695:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33aa8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394705:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788793919.394709:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394713:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55ae00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793919.394716:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394722:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793919.394728:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793919.394732:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793919.394744:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394749:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793919.394761:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.394768:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33aa7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.395078:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793919.395082:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.395088:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55bc00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793919.395091:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.395098:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793919.395104:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793919.395109:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793919.395147:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.395153:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793919.395159:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.395165:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33aa71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa78 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.395174:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793919.395181:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793919.395183:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793919.395205:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729672960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.395266:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793919.395330:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729673472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.395351:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793919.395375:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788793919.395380:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729673344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.395397:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793919.395427:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.395447:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793919.395462:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.395478:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793919.395490:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788793919.395494:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.395738:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793919.395857:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793919.395865:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9719:x1875685729672832:12345-0@lo:104: Request processed in 3127us (3822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.395874:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788793919.395903:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793919.395908:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.395914:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af501b60200 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:0.0:1788793919.395918:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.395925:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793919.395932:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793919.395937:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793919.395962:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.395969:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793919.395980:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.395986:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af501b60200/0x962a5e377b33aa63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33aa6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.396010:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793919.396012:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793919.396014:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793919.396020:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793919.396035:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788793919.396044:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788793919.396070:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793919.396086:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793919.396218:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729672960 00000100:00100000:0.0:1788793919.396226:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729672960 00010000:00010000:0.0:1788793919.396254:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 19 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396272:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673472 00000100:00100000:0.0:1788793919.396275:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673472 00010000:00010000:0.0:1788793919.396286:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 20 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673344 00000100:00100000:0.0:1788793919.396310:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673344 00010000:00010000:0.0:1788793919.396322:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 21 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673088 00000100:00100000:0.0:1788793919.396347:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673088 00010000:00010000:0.0:1788793919.396359:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 22 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673600 00000100:00100000:0.0:1788793919.396369:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673600 00010000:00010000:0.0:1788793919.396379:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 23 pid: 6523 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673216 00000100:00100000:0.0:1788793919.396388:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673216 00010000:00010000:0.0:1788793919.396397:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 24 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673728 00000100:00100000:0.0:1788793919.396409:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673728 00010000:00010000:0.0:1788793919.396419:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 25 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.396432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793919.396440:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+25:3464:x1875685729672960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788793919.396452:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793919.396457:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 25 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.396466:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 25 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.396479:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33aabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aab7 expref: 25 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793919.396499:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.396621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788793919.396632:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+24:3464:x1875685729673472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793919.396641:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793919.396646:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 24 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.396655:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 24 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.396665:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b200/0x962a5e377b33aa86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aa7f expref: 24 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.396685:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.396895:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+23:3464:x1875685729673472:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793919.396902:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788793919.396918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788793919.396924:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+22:3464:x1875685729673344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793919.396931:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793919.396936:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 22 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.396944:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 22 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.396954:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af501b60e00/0x962a5e377b33aa94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aa8d expref: 22 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.396963:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.396984:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+21:3464:x1875685729673344:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793919.396989:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788793919.397014:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788793919.397021:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3461:x1875685729673088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793919.397028:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793919.397032:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 20 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397040:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 20 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397058:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33aab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aaa9 expref: 20 pid: 6524 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397067:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.397094:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729673088:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793919.397101:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788793919.397113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788793919.397119:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:3461:x1875685729673600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793919.397143:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793919.397148:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 18 pid: 6523 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397156:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 18 pid: 6523 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397165:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af501b61c00/0x962a5e377b33aa78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aa71 expref: 18 pid: 6523 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397173:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.397194:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:3461:x1875685729673600:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793919.397201:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788793919.397212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788793919.397217:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:3461:x1875685729673216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793919.397225:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793919.397229:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 16 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397242:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 16 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397252:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166a400/0x962a5e377b33aaa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aa9b expref: 16 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397262:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.397283:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:3461:x1875685729673216:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793919.397290:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788793919.397315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788793919.397321:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3461:x1875685729673728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793919.397328:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793919.397333:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 14 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397341:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 14 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793919.397349:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793919.397369:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3461:x1875685729673728:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793919.397375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788793919.397413:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729673344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.397423:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729673472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793919.398401:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793919.398429:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793919.398466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619456 00000100:00100000:3.0:1788793919.398472:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619456 00010000:00010000:3.0:1788793919.398497:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 10 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793919.398667:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619328 00000100:00100000:3.0:1788793919.398672:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619328 00010000:00010000:3.0:1788793919.398752:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 11 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793919.398855:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:3.0:1788793919.398864:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+11:2371:x1875685707619456:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788793919.398875:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793919.398937:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 11 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.398947:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 11 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.398965:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793919.399091:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+11:2371:x1875685707619456:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 228us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793919.399098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:3.0:1788793919.399165:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:3.0:1788793919.399172:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707619328:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788793919.399179:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793919.399195:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 10 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399204:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 10 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399216:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399226:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399241:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399248:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399255:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399261:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399267:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af501b61000 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:3.0:1788793919.399271:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.399278:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793919.399502:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3464:x1875685729672960:12345-0@lo:103:ldlm_bl.0 Request processed in 3061us (4234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793919.399510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793919.399657:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788793919.399668:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788793919.399675:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788793919.399683:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729673600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793919.399964:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729672960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793919.400078:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793919.400098:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793919.400157:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707619328:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 983us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793919.400165:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00010000:00010000:2.0:1788793919.401366:0:9719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4fe55ac00/0x962a5e377b33aa6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33aa63 expref: 12 pid: 6522 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.401382:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729672832:0@lo:104: 00010000:00010000:2.0:1788793919.401437:0:9719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166a000/0x962a5e377b33aacc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c4e expref: 9 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.401447:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729671808:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793919.401459:0:9719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b400/0x962a5e377b33aac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c47 expref: 8 pid: 6522 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793919.401468:0:9719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9719:1875685729671936:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793919.402225:0:9719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.402238:0:9719:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.402245:0:9719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793919.402269:0:9719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af501b61000/0x962a5e377b33ab0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793919.819460:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788793919.819486:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788793919.819570:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793919.819932:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673856 00000100:00100000:2.0:1788793919.819941:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673856 00000100:00100000:2.0:1788793919.820014:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793919.820037:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729673856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788793919.820067:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788793919.820118:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3464:x1875685729673856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793919.820150:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788793919.820392:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793919.820423:0:3464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4fabf0a80 x1875685729673856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793919.820442:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3464:1875685729673856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788793919.821070:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793920.449503:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793920.449581:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619584 00000100:00100000:3.0:1788793920.449592:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619584 00000100:00100000:3.0:1788793920.449649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 198 00000100:00100000:3.0:1788793920.449659:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+8:6849:x1875685707619584:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.449687:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.449707:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c5c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.449733:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.449754:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.449763:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d1600, rc 0) 00000100:00100000:3.0:1788793920.449829:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707619584:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 170us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.449837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 198 00000100:00100000:3.0:1788793920.457444:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793920.457646:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619712 00000100:00100000:1.0:1788793920.457655:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619712 00000100:00100000:1.0:1788793920.457721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 199 00000100:00100000:1.0:1788793920.457730:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707619712:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.457888:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707619712:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 159us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.457897:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 199 00000100:00100000:2.0:1788793920.464404:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793920.464488:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619840 00000100:00100000:3.0:1788793920.464507:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619840 00000100:00100000:3.0:1788793920.464563:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 200 00000100:00100000:3.0:1788793920.464574:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707619840:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.464874:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707619840:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 301us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.464891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 200 00000100:00100000:2.0:1788793920.483163:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793920.483238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707619968 00000100:00100000:3.0:1788793920.483248:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707619968 00000100:00100000:3.0:1788793920.483313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 201 00000100:00100000:3.0:1788793920.483322:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707619968:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.483339:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.483356:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c63 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.483382:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.483393:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.483402:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d1e00, rc 0) 00000100:00100000:3.0:1788793920.483466:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707619968:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 145us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.483486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 201 00000100:00100000:2.0:1788793920.496316:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793920.504400:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620096 00000100:00100000:3.0:1788793920.504417:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620096 00000100:00100000:3.0:1788793920.504487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 202 00000100:00100000:3.0:1788793920.504508:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707620096:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.504685:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707620096:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 179us (8378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.504692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 202 00000100:00100000:0.0:1788793920.508988:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793920.509154:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620224 00000100:00100000:1.0:1788793920.509166:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620224 00000100:00100000:1.0:1788793920.509215:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:1.0:1788793920.509224:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707620224:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.509517:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707620224:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 292us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.509526:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:2.0:1788793920.518232:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793920.518826:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620352 00000100:00100000:3.0:1788793920.518837:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620352 00000100:00100000:3.0:1788793920.520143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 204 00000100:00100000:3.0:1788793920.520164:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:7635:x1875685707620352:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788793920.520346:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:7635:x1875685707620352:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 188us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.526666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 204 00000100:00100000:3.0:1788793920.532826:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793920.533064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620480 00000100:00100000:2.0:1788793920.533074:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620480 00000100:00100000:2.0:1788793920.533162:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00100000:2.0:1788793920.533173:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:7635:x1875685707620480:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788793920.533346:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:7635:x1875685707620480:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 175us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793920.533353:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 205 10000000:01000000:2.0:1788793920.715344:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793920.715352:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4fa80f000 from 42 10000000:01000000:2.0:1788793920.715357:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793920.715408:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793920.715436:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793920.715449:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793920.715477:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729673984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793920.715555:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793920.715618:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.715908:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729673984 00000100:00100000:3.0:1788793920.715917:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729673984 00000100:00100000:3.0:1788793920.715970:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788793920.715979:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729673984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.715994:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.716007:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab20 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.716032:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.716051:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.716061:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d1c00, rc 0) 00000100:00100000:3.0:1788793920.716101:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729673984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.716109:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788793920.716240:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729673984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793920.716256:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.716266:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793920.716339:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.716366:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.716396:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793920.716451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674112 00000100:00100000:2.0:1788793920.716456:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674112 00000100:00100000:2.0:1788793920.716511:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788793920.716520:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729674112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793920.716642:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729674112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793920.716650:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788793920.716798:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.716824:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.716870:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.727446:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793920.727526:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674240 00000100:00100000:1.0:1788793920.727536:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674240 00000100:00100000:1.0:1788793920.727594:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788793920.727604:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729674240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.728433:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729674240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 827us (11557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.728443:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788793920.729454:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788793920.735519:0:9738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1788793920.735600:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1788793920.735620:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788793920.735632:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.735644:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793920.735654:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788793920.735657:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788793920.735659:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788793920.735708:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.735716:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.735728:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793920.735762:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.735828:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.735865:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade780 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.736718:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674368 00000100:00100000:3.0:1788793920.736727:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674368 00000100:00100000:3.0:1788793920.736786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788793920.736795:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729674368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.736809:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.736826:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab2e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.736853:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.736863:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.736872:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0000, rc 0) 00000100:00100000:3.0:1788793920.736926:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729674368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.736933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788793920.738238:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793920.738302:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.738313:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793920.738391:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.738436:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.738471:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade780 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.738925:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674496 00000100:00100000:3.0:1788793920.738931:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674496 00000100:00100000:3.0:1788793920.738985:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788793920.738994:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729674496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.739159:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729674496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.739167:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788793920.739250:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793920.739302:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793920.739342:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793920.739373:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.739615:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674624 00000100:00100000:3.0:1788793920.739620:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674624 00000100:00100000:3.0:1788793920.739652:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788793920.739658:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729674624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.739758:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729674624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.739765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788793920.740229:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788793920.741670:0:9740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:0.0:1788793920.746024:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788793920.746064:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788793920.746077:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.746089:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793920.746230:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788793920.746234:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af501bb0000 from 42 10000000:01000000:1.0:1788793920.746238:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788793920.746304:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.746330:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.746343:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793920.746374:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.746456:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.746527:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.746887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674752 00000100:00100000:3.0:1788793920.746895:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674752 00000100:00100000:3.0:1788793920.746948:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788793920.746958:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729674752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.746973:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.746986:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab3c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.747011:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.747021:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.747029:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0800, rc 0) 00000100:00100000:3.0:1788793920.747079:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729674752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.747094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788793920.747283:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793920.747300:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.747310:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793920.747368:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.747395:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.747427:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.747470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729674880 00000100:00100000:3.0:1788793920.747475:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729674880 00000100:00100000:3.0:1788793920.747514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788793920.747521:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729674880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.747639:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729674880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.747645:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788793920.747910:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729674880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.747939:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.747981:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.748003:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793920.748048:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675008 00000100:00100000:0.0:1788793920.748053:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675008 00000100:00100000:1.0:1788793920.759265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788793920.759304:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729675008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.759480:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729675008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (11497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.759488:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788793920.767902:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788793920.773789:0:9742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:1.0:1788793920.774188:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:1.0:1788793920.774218:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793920.774231:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.774243:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793920.774252:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788793920.774255:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788793920.774258:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788793920.774316:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.774324:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.774336:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793920.774363:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.774428:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.774463:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.777644:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675136 00000100:00100000:3.0:1788793920.777659:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675136 00000100:00100000:3.0:1788793920.777805:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788793920.777816:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729675136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.777836:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.777861:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab4a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.777895:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.777907:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.777917:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c29d0e00, rc 0) 00000100:00100000:3.0:1788793920.779234:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729675136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1414us (4799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.779244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788793920.787326:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793920.787367:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.787381:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793920.787469:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.787540:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.787574:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.787850:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675264 00000100:00100000:3.0:1788793920.787863:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675264 00000100:00100000:3.0:1788793920.787914:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788793920.787923:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729675264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.788063:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729675264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.788070:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788793920.789837:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.789897:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.789960:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.789990:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.790091:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675392 00000100:00100000:3.0:1788793920.790098:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675392 00000100:00100000:3.0:1788793920.790168:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788793920.790176:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729675392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.790305:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729675392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.790312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788793920.796847:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788793920.799068:0:9744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1788793920.799305:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788793920.799335:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788793920.799346:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.799358:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793920.799368:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788793920.799371:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4dfc78000 from 42 10000000:01000000:1.0:1788793920.799374:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788793920.799413:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.799422:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.799448:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793920.799474:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.799554:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793920.799607:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.799992:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675520 00000100:00100000:3.0:1788793920.800002:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675520 00000100:00100000:3.0:1788793920.800054:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788793920.800064:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729675520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.800077:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793920.800092:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab58 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.800114:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.800151:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.800169:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1513a00, rc 0) 00000100:00100000:3.0:1788793920.800216:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729675520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.800223:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788793920.800292:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793920.800310:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.800320:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793920.800376:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.800403:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793920.800420:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.800433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675648 00000100:00100000:3.0:1788793920.800437:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675648 00000100:00100000:3.0:1788793920.800463:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788793920.800468:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729675648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.802497:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729675648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2010us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.802509:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788793920.804200:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.804263:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.804340:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.804378:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade840 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.804870:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675776 00000100:00100000:3.0:1788793920.804879:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675776 00000100:00100000:3.0:1788793920.804936:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788793920.804947:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729675776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.805079:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729675776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.805087:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788793920.805200:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788793920.810073:0:9745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1788793920.810406:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1788793920.810430:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788793920.810441:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.810468:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793920.810479:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788793920.810481:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:0.0:1788793920.810484:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788793920.810521:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.810529:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.810539:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793920.810562:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.810624:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.810677:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade600 going to sleep for 11 seconds 00000100:00100000:1.0:1788793920.810950:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729675904 00000100:00100000:1.0:1788793920.810958:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729675904 00000100:00100000:1.0:1788793920.811009:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788793920.811019:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729675904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793920.811031:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793920.811044:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab66 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.811066:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.811076:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793920.811084:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166b800, rc 0) 00000100:00100000:1.0:1788793920.811147:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729675904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.811154:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788793920.811242:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729675904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793920.811257:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.811267:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793920.811334:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.811359:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.811392:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade600 going to sleep for 11 seconds 00000100:00100000:1.0:1788793920.811475:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676032 00000100:00100000:1.0:1788793920.811480:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676032 00000100:00100000:1.0:1788793920.811518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788793920.811525:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729676032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.811641:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729676032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.811647:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788793920.811830:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.811858:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.811899:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.811923:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade600 going to sleep for 11 seconds 00000100:00100000:1.0:1788793920.815627:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676160 00000100:00100000:1.0:1788793920.815643:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676160 00000100:00100000:1.0:1788793920.815726:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788793920.815738:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729676160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793920.815917:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729676160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (4017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793920.815924:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788793920.815989:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788793920.819587:0:9746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 64768 count 37 00000020:01000000:3.0:1788793920.819773:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-36 (rc=0) 10000000:01000000:3.0:1788793920.819796:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788793920.819807:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.819818:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793920.819829:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788793920.819832:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af4ce6799e8 from 1 10000000:01000000:3.0:1788793920.819835:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788793920.819875:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.819883:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.819896:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793920.819921:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f730f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793920.819988:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793920.820013:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe48d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793920.824055:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676288 00000100:00100000:0.0:1788793920.824067:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676288 00000100:00100000:0.0:1788793920.824140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788793920.824150:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729676288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793920.824166:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793920.824184:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab74 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.824213:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.824225:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.824234:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55a800, rc 0) 00000100:00100000:0.0:1788793920.824317:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729676288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (4328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793920.824324:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788793920.824381:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f730f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793920.824399:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.824409:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793920.826785:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.826854:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.826901:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676416 00000100:00100000:0.0:1788793920.826907:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676416 00000100:00100000:0.0:1788793920.826954:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788793920.826962:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729676416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.827088:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729676416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793920.827095:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788793920.827144:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade780 going to sleep for 11 seconds 00000100:00100000:0.0:1788793920.827163:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.827203:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.827245:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.827266:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676544 00000100:00100000:0.0:1788793920.827269:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676544 00000100:00100000:0.0:1788793920.827306:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788793920.827313:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729676544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.827382:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729676544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793920.827389:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788793920.827419:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade780 going to sleep for 11 seconds 00000100:00100000:0.0:1788793920.827430:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729676544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793920.832009:0:9748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9748:1875685729676672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793920.832097:0:9748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.832382:0:9748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade840 going to sleep for 11 seconds 00000100:00100000:2.0:1788793920.835392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676672 00000100:00100000:2.0:1788793920.835406:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676672 00000100:00100000:0.0:1788793920.837097:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788793920.837108:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9748:x1875685729676672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793920.837293:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9748:x1875685729676672:12345-0@lo:502:llog_process_th.0 Request processed in 186us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793920.837302:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788793920.837372:0:9748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9748:1875685729676672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788793920.837402:0:9748:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793920.837410:0:9748:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793920.837413:0:9748:0:(obd_config.c:1547:class_process_config()) marker 28 (0x1) lustre srpc.flavor.default.cli2mdt 00000020:00000080:0.0:1788793920.837418:0:9748:0:(obd_config.c:1456:class_process_config()) processing cmd: ce016 00000100:00100000:0.0:1788793920.837754:0:9748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9748:1875685729676800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793920.837803:0:9748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793920.837877:0:9748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1788793920.839655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676800 00000100:00100000:3.0:1788793920.839677:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676800 00000100:00100000:3.0:1788793920.839740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788793920.839759:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9748:x1875685729676800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793920.839927:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9748:x1875685729676800:12345-0@lo:502:llog_process_th.0 Request processed in 169us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793920.839933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788793920.840167:0:9748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9748:1875685729676800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788793920.840200:0:9748:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793920.840207:0:9748:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793920.840209:0:9748:0:(obd_config.c:1547:class_process_config()) marker 28 (0x2) lustre srpc.flavor.default.cli2mdt 00000040:00080000:2.0:1788793920.840214:0:9748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 4 count 4 00000020:01000000:3.0:1788793920.840474:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-sptlrpc gen 1-3 (rc=0) 10000000:01000000:3.0:1788793920.840612:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' succeeded (0). 00010000:00010000:3.0:1788793920.840623:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793920.840635:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793920.844204:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788793921.208947:0:9774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=ski 00010000:00010000:0.0:1788793921.867370:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793921.987734:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793921.987773:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793921.987808:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793921.987836:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793921.987862:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620608 00000100:00100000:3.0:1788793921.987872:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620608 00000100:00100000:3.0:1788793921.987920:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 229 00000100:00100000:3.0:1788793921.987930:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2372:x1875685707620608:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1788793921.987993:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2372:x1875685707620608:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793921.988000:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 229 00000100:00100000:3.0:1788793921.988033:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620992 00000100:00100000:3.0:1788793921.988037:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620992 00000100:00100000:3.0:1788793921.988069:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620864 00000100:00100000:3.0:1788793921.988072:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620864 00000100:00100000:3.0:1788793921.988092:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:3.0:1788793921.988110:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2372:x1875685707620992:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1788793921.988165:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2372:x1875685707620992:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 55us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793921.988318:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707620736 00000100:00100000:1.0:1788793921.988322:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707620736 00000100:00100000:1.0:1788793921.988357:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:1.0:1788793921.988365:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+6:2372:x1875685707620736:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1788793921.988394:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+6:2372:x1875685707620736:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793921.988400:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:3.0:1788793921.988448:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:3.0:1788793921.988464:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:3.0:1788793921.988471:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2372:x1875685707620864:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1788793921.988497:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2372:x1875685707620864:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793921.988503:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00080000:3.0:1788793921.988605:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788793921.988610:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788793921.988612:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788793922.507465:0:9822:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe35a51c00 20000000:00000080:0.0:1788793922.508081:0:9822:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9af4f75ea400 uarg=0000000000000000 20000000:01000000:0.0:1788793922.508157:0:9822:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788793922.508159:0:9822:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788793922.508162:0:9822:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='srpc.flavor.default.cli2ost=ski' 20000000:01000000:0.0:1788793922.508167:0:9822:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'srpc.flavor.default.cli2ost=ski' 20000000:01000000:0.0:1788793922.508273:0:9822:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-sptlrpc/lustre/srpc.flavor.default.cli2ost fl=4 00000040:00080000:0.0:1788793922.509303:0:9823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 4 count 4 00000040:00080000:2.0:1788793922.509526:0:9822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8968 00000040:00080000:2.0:1788793922.509571:0:9822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 104 off9072 00000040:00080000:2.0:1788793922.509591:0:9822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9296 10000000:01000000:2.0:1788793922.509606:0:9822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788793922.509625:0:9822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509782:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509791:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509799:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509805:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509812:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509831:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509838:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509845:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509851:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509858:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509908:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.509924:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 18 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.509938:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729676928:0@lo:104: 00000100:00100000:2.0:1788793922.510076:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793922.510364:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.510372:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 18 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.510381:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677056:0@lo:104: 00000100:00100000:2.0:1788793922.510410:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793922.510533:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.510540:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 18 pid: 6524 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.510548:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677184:0@lo:104: 00000100:00100000:2.0:1788793922.510569:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793922.511917:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.511929:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 18 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.511939:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677312:0@lo:104: 00000100:00100000:2.0:1788793922.511972:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793922.512202:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729676928 00000100:00100000:1.0:1788793922.512210:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729676928 00000100:00100000:1.0:1788793922.512265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677056 00000100:00100000:1.0:1788793922.512268:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677056 00000100:00100000:1.0:1788793922.512279:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677184 00000100:00100000:1.0:1788793922.512282:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677184 00000100:00100000:1.0:1788793922.512310:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788793922.512318:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9822:x1875685729676928:12345-0@lo:104: 00010000:00010000:1.0:1788793922.512330:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.512381:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793922.512387:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+5:9822:x1875685729676928:12345-0@lo:104: Request processed in 70us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.512393:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788793922.512410:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788793922.512415:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9822:x1875685729677056:12345-0@lo:104: 00010000:00010000:1.0:1788793922.512423:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.512457:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788793922.512463:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9822:x1875685729677056:12345-0@lo:104: Request processed in 48us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.512468:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788793922.513614:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788793922.513624:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513645:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c1512200 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793922.513650:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513658:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793922.513664:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793922.513670:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793922.513708:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513723:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793922.513745:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513752:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c1512200/0x962a5e377b33ab74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513766:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793922.513769:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513775:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55ae00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793922.513778:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513784:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793922.513790:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793922.513795:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793922.513809:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513814:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793922.513829:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513835:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4fe55ae00/0x962a5e377b33ab66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.513852:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.513853:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.513855:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793922.513895:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729677440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.513940:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793922.514000:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729677568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.514023:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793922.514053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677440 00000100:00100000:3.0:1788793922.514059:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677440 00010000:00010000:3.0:1788793922.514083:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 19 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793922.514104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677568 00000100:00100000:3.0:1788793922.514107:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677568 00010000:00010000:3.0:1788793922.514118:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 20 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793922.514167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788793922.514175:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3464:x1875685729677440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.514186:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793922.514192:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 20 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.514202:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 20 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.514219:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793922.514280:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3464:x1875685729677440:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.514294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788793922.514310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788793922.514316:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729677568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.514323:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793922.514328:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 19 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.514335:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 19 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.514344:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793922.514368:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3461:x1875685729677568:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.514373:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788793922.514410:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729677568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.514431:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729677440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793922.518518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788793922.518541:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9822:x1875685729677184:12345-0@lo:104: 00010000:00010000:1.0:1788793922.518563:0:6511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.518788:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793922.518795:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9822:x1875685729677184:12345-0@lo:104: Request processed in 266us (8225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.518803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788793922.518832:0:6516:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793922.518852:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.518860:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166b000 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:1.0:1788793922.518864:0:6516:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.518872:0:6516:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793922.518879:0:6516:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793922.518885:0:6516:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793922.518922:0:6516:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.518927:0:6516:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793922.518948:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.518955:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166b000/0x962a5e377b33ab58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.518969:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793922.518971:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793922.518973:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793922.519058:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729677696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788793922.519101:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793922.519189:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677696 00000100:00100000:1.0:1788793922.519197:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677696 00010000:00010000:1.0:1788793922.519229:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 19 pid: 6524 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793922.519269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788793922.519276:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3462:x1875685729677696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793922.519288:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793922.519293:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 19 pid: 6524 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.519303:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 19 pid: 6524 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.519319:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793922.519349:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3462:x1875685729677696:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.519355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788793922.519388:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3462:1875685729677696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.519528:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793922.520386:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.520399:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 18 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.520410:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677824:0@lo:104: 00000100:00100000:2.0:1788793922.520445:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793922.520605:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.520614:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 18 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.520649:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677952:0@lo:104: 00000100:00100000:2.0:1788793922.520675:0:9822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793922.520691:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677312 00000100:00100000:1.0:1788793922.520697:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677312 00000100:00100000:0.0:1788793922.520733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677824 00000100:00100000:0.0:1788793922.520737:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677824 00000100:00100000:0.0:1788793922.520756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788793922.520770:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9822:x1875685729677312:12345-0@lo:104: 00010000:00010000:0.0:1788793922.520782:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.520835:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793922.520841:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9822:x1875685729677312:12345-0@lo:104: Request processed in 73us (8868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.520847:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788793922.520862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788793922.520868:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9822:x1875685729677824:12345-0@lo:104: 00010000:00010000:0.0:1788793922.520876:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.520923:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788793922.520928:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9822:x1875685729677824:12345-0@lo:104: Request processed in 61us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.520933:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788793922.521168:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788793922.521175:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521183:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166b200 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793922.521187:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521196:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793922.521214:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793922.521220:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793922.521265:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521271:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793922.521291:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521298:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166b200/0x962a5e377b33ab4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab51 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521312:0:8595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793922.521315:0:8595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521321:0:8595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4c166a400 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793922.521323:0:8595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521329:0:8595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793922.521334:0:8595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793922.521338:0:8595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793922.521359:0:8595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521365:0:8595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793922.521372:0:8595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521377:0:8595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4c166a400/0x962a5e377b33ab3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab43 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521387:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.521388:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.521390:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793922.521401:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729678208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.521434:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793922.521456:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788793922.521461:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729678080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.521493:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793922.521517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729678208 00000100:00100000:3.0:1788793922.521522:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729678208 00010000:00010000:3.0:1788793922.521538:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 19 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793922.521557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729678080 00000100:00100000:3.0:1788793922.521560:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729678080 00010000:00010000:3.0:1788793922.521569:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 20 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793922.521585:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788793922.521591:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3464:x1875685729678208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.521610:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793922.521616:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 20 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521625:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 20 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521653:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793922.521681:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+20:3464:x1875685729678208:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.521687:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788793922.521702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788793922.521708:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729678080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.521715:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793922.521719:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 19 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521727:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 19 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.521736:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793922.521755:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:3464:x1875685729678080:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.521761:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788793922.521793:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729678080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.521801:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3464:1875685729678208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788793922.522160:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.522171:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 18 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522180:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729678336:0@lo:104: 00010000:00010000:2.0:1788793922.522207:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.522218:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 9 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522228:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729678464:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793922.522292:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.522301:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 9 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522310:0:9822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729678592:192.168.201.8@tcp:104: 00000100:00100000:2.0:1788793922.522330:0:9822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776cf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788793922.522343:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4fe55a800/0x962a5e377b33ab7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab74 expref: 18 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522365:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729676928:0@lo:104: 00010000:00010000:2.0:1788793922.522377:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c166b800/0x962a5e377b33ab6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab66 expref: 17 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522386:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677056:0@lo:104: 00010000:00010000:2.0:1788793922.522395:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c1513a00/0x962a5e377b33ab5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab58 expref: 16 pid: 6524 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522404:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677184:0@lo:104: 00010000:00010000:2.0:1788793922.522411:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0e00/0x962a5e377b33ab51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab4a expref: 15 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522419:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677312:0@lo:104: 00010000:00010000:2.0:1788793922.522427:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0800/0x962a5e377b33ab43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab3c expref: 14 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.522434:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677824:0@lo:104: 00000100:00100000:0.0:1788793922.522506:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788793922.522524:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793922.522535:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729677952 00000100:00100000:0.0:1788793922.522539:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729677952 00000100:00100000:0.0:1788793922.522558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729678336 00000100:00100000:0.0:1788793922.522561:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729678336 00000100:00100000:0.0:1788793922.522572:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788793922.522578:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f75eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9822:x1875685729677952:12345-0@lo:104: 00010000:00010000:0.0:1788793922.522586:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.522740:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793922.522751:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f75eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+4:9822:x1875685729677952:12345-0@lo:104: Request processed in 174us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.522758:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788793922.522792:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788793922.522798:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9822:x1875685729678336:12345-0@lo:104: 00010000:00010000:0.0:1788793922.522806:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.522834:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788793922.522839:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+3:9822:x1875685729678336:12345-0@lo:104: Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.522845:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788793922.522967:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729677952:0@lo:104: 00000100:00100000:2.0:1788793922.522974:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729678336:0@lo:104: 00010000:00010000:3.0:1788793922.523462:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788793922.523541:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523550:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af4fe55bc00 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793922.523553:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523562:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793922.523568:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793922.523574:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793922.523647:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523655:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793922.523685:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523693:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af4fe55bc00/0x962a5e377b33ab2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab35 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523705:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793922.523708:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523713:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af501b61600 already unused, calling callback (ffffffffc14dac20) 10000000:00010000:3.0:1788793922.523716:0:6517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.523732:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793922.523738:0:6517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793922.523743:0:6517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788793922.523807:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729678720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793922.523846:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793922.524112:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793922.524145:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729678720 00000100:00100000:1.0:1788793922.524151:0:9464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729678720 00010000:00010000:1.0:1788793922.524177:0:9464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 14 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793922.524204:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788793922.524211:0:9464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:3461:x1875685729678720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793922.524222:0:9464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793922.524227:0:9464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 14 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.524256:0:9464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 14 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.524269:0:9464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d0000/0x962a5e377b33ab35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab2e expref: 14 pid: 6522 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793922.524282:0:9464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793922.524317:0:9464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3461:x1875685729678720:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.524324:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788793922.524375:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729678720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.524861:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.524869:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793922.524900:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.524908:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33ab20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x962a5e377b33ab27 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.524921:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.524923:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.524925:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793922.524936:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793922.525200:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788793922.525211:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729678848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793922.525260:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793922.525329:0:9464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729678848 00000100:00100000:3.0:1788793922.525334:0:9464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729678848 00010000:00010000:3.0:1788793922.525353:0:9464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 13 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793922.525384:0:9464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788793922.525390:0:9464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:3461:x1875685729678848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788793922.525399:0:9464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793922.525413:0:9464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 13 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.525424:0:9464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 13 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.525435:0:9464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1c00/0x962a5e377b33ab27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x962a5e377b33ab20 expref: 13 pid: 6523 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793922.525446:0:9464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793922.525493:0:9464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:3461:x1875685729678848:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.525499:0:9464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788793922.525528:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:3461:1875685729678848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788793922.534444:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793922.534568:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793922.534673:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621120 00000100:00100000:0.0:1788793922.534684:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621120 00010000:00010000:0.0:1788793922.534725:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 10 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793922.534754:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621248 00000100:00100000:0.0:1788793922.534757:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621248 00010000:00010000:0.0:1788793922.534769:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 11 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793922.534791:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:0.0:1788793922.534800:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+11:2370:x1875685707621120:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788793922.534815:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793922.534821:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 11 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534832:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 11 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534866:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793922.534905:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+11:2370:x1875685707621120:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 107us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.534910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:0.0:1788793922.534923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:0.0:1788793922.534927:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707621248:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788793922.534932:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793922.534935:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 10 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534941:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 10 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534949:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534955:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534965:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534969:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.534974:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.535286:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.535299:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9af501b60a00 already unused, calling callback (ffffffffc0ec48b0) 00010000:00010000:0.0:1788793922.535304:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.535313:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.535323:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793922.535334:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793922.535362:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2371:x1875685707621248:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 433us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.535369:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 42 00010000:00010000:2.0:1788793922.535578:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1e00/0x962a5e377b33ab19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c63 expref: 9 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.535612:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729678464:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793922.535628:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af4c29d1600/0x962a5e377b33ab12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c5c expref: 8 pid: 6522 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793922.535637:0:9822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9822:1875685729678592:192.168.201.8@tcp:104: 00010000:00010000:2.0:1788793922.535686:0:9822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.535696:0:9822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.535701:0:9822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793922.535707:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab82 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793922.891360:0:3464:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788793922.891382:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729678976:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.891447:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793922.891529:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729678976 00000100:00100000:1.0:1788793922.891537:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729678976 00000100:00100000:1.0:1788793922.891580:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788793922.891588:0:9223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729678976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.891645:0:9223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3464:x1875685729678976:12345-0@lo:400:kworker.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.891652:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788793922.891692:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3464:1875685729678976:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.891731:0:3464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1875685729679104:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.891756:0:3464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793922.891786:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679104 00000100:00100000:1.0:1788793922.891801:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679104 00000100:00100000:1.0:1788793922.891833:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788793922.891840:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1875685729679104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.891887:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3464:x1875685729679104:12345-0@lo:400:kworker.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.891895:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788793922.892093:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788793922.892119:0:3464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3464:1875685729679104:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.892181:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729679232:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.892209:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793922.892261:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679232 00000100:00100000:1.0:1788793922.892265:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679232 00000100:00100000:1.0:1788793922.892319:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788793922.892326:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729679232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.892361:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1875685729679232:12345-0@lo:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793922.892367:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788793922.892383:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788793922.892403:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4f78ec380 x1875685729679232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793922.892413:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3461:1875685729679232:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.892441:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1875685729679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788793922.892602:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729679488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788793922.892643:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788793922.892661:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788793922.892679:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679488 00000100:00100000:3.0:1788793922.892683:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679488 00000100:00100000:3.0:1788793922.892723:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788793922.892730:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729679488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788793922.892750:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788793922.892784:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729679488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.892790:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788793922.892819:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d3800 x1875685729679488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793922.892848:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729679488:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788793922.892922:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788793922.893110:0:3463:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793922.893118:0:3463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729679616:0@lo:400:kworker.0 00000100:00100000:3.0:1788793922.893161:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793922.893184:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679616 00000100:00100000:3.0:1788793922.893188:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679616 00000100:00100000:3.0:1788793922.893209:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788793922.893216:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729679616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788793922.893260:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3463:x1875685729679616:12345-0@lo:400:kworker.0 Request processed in 44us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793922.893267:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788793922.893290:0:3463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4ce4d3800 x1875685729679616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793922.893299:0:3463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3463:1875685729679616:0@lo:400:kworker.0 00000100:00100000:1.0:1788793922.894025:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793922.898592:0:9223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679360 00000100:00100000:0.0:1788793922.898607:0:9223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679360 00000100:00100000:0.0:1788793922.899018:0:9223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788793922.899029:0:9223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f78ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1875685729679360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788793922.899154:0:9223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f78ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3462:x1875685729679360:12345-0@lo:400:kworker.0 Request processed in 127us (6687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793922.899162:0:9223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788793922.899340:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3462:1875685729679360:0@lo:400:kworker.0 00000100:00080000:1.0:1788793922.899416:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788793923.778952:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793923.779331:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621376 00000100:00100000:0.0:1788793923.779347:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621376 00000100:00100000:0.0:1788793923.779421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 230 00000100:00100000:0.0:1788793923.779432:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+8:6849:x1875685707621376:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793923.779475:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793923.779502:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55a600/0x962a5e377b33ab89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c6a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793923.779537:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55a600/0x962a5e377b33ab89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c6a expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793923.779551:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55a600/0x962a5e377b33ab89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c6a expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793923.779562:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55a600, rc 0) 00000100:00100000:0.0:1788793923.779653:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707621376:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 223us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793923.779661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 230 00000100:00100000:3.0:1788793923.793704:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793923.793889:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621504 00000100:00100000:0.0:1788793923.793903:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621504 00000100:00100000:0.0:1788793923.794096:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 231 00000100:00100000:0.0:1788793923.794110:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707621504:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793923.794398:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707621504:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 290us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793923.794407:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 231 00000100:00100000:1.0:1788793923.802373:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793923.802563:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621632 00000100:00100000:3.0:1788793923.802578:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621632 00000100:00100000:3.0:1788793923.803305:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 232 00000100:00100000:3.0:1788793923.803321:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707621632:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793923.803548:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707621632:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 222us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793923.803557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 232 00000100:00100000:3.0:1788793923.814561:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793923.814869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621760 00000100:00100000:2.0:1788793923.814884:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621760 00000100:00100000:2.0:1788793923.814976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 233 00000100:00100000:2.0:1788793923.814987:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+9:6849:x1875685707621760:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793923.815008:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793923.815031:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b61200/0x962a5e377b33ab90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfb2c4816b4eb6c71 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793923.815066:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b61200/0x962a5e377b33ab90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c71 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793923.815105:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b61200/0x962a5e377b33ab90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0xfb2c4816b4eb6c71 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793923.815116:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b61200, rc 0) 00000100:00100000:2.0:1788793923.815455:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707621760:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 469us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793923.815462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 233 00000100:00100000:2.0:1788793923.824584:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793923.824737:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707621888 00000100:00100000:3.0:1788793923.824752:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707621888 00000100:00100000:3.0:1788793923.824826:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 234 00000100:00100000:3.0:1788793923.824839:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707621888:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793923.825302:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707621888:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 464us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793923.825312:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 234 00000100:00100000:1.0:1788793923.827482:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793923.827601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622016 00000100:00100000:2.0:1788793923.827620:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622016 00000100:00100000:2.0:1788793923.827703:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 235 00000100:00100000:2.0:1788793923.827714:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707622016:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793923.827875:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2abe3cab-b632-4e65-86e0-311de8a706de+10:6849:x1875685707622016:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 163us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793923.827883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 235 00000100:00100000:0.0:1788793923.839802:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793923.840212:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622144 00000100:00100000:3.0:1788793923.840239:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622144 00000100:00100000:3.0:1788793923.840316:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 236 00000100:00100000:3.0:1788793923.840327:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:7703:x1875685707622144:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788793923.840545:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:7703:x1875685707622144:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 219us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793923.840554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 236 00000100:00100000:3.0:1788793923.843785:0:3455:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793923.844014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622272 00000100:00100000:0.0:1788793923.844029:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622272 00000100:00100000:0.0:1788793923.844176:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 237 00000100:00100000:0.0:1788793923.844190:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:7703:x1875685707622272:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788793923.844398:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2abe3cab-b632-4e65-86e0-311de8a706de+10:7703:x1875685707622272:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 210us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793923.844429:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 237 00010000:00010000:3.0:1788793923.915570:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788793924.107367:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788793924.107377:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4fa80f000 from 42 10000000:01000000:0.0:1788793924.107384:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788793924.107517:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.107534:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.107546:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793924.107578:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729679744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.108038:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793924.108154:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793924.108353:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679744 00000100:00100000:2.0:1788793924.108363:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679744 00000100:00100000:2.0:1788793924.108461:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788793924.108473:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+12:6526:x1875685729679744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793924.108491:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793924.108508:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33ab97 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.108537:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33ab97 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.108571:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af501b60a00/0x962a5e377b33ab9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33ab97 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.108581:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af501b60a00, rc 0) 00000100:00100000:2.0:1788793924.108998:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729679744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 526us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793924.109006:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788793924.109178:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729679744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793924.109199:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab9e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.109210:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33ab9e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793924.109310:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729679872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.109343:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793924.109386:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.109452:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729679872 00000100:00100000:3.0:1788793924.109459:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729679872 00000100:00100000:3.0:1788793924.109498:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788793924.109508:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729679872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.109672:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729679872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793924.109690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788793924.109894:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729679872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793924.109928:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793924.109990:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793924.110014:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4e027c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.110151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680000 00000100:00100000:0.0:1788793924.110157:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680000 00000100:00100000:0.0:1788793924.110199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788793924.110207:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729680000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.110322:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729680000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.110329:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788793924.110498:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788793924.118535:0:9835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1788793924.118993:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1788793924.119027:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788793924.119043:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab9e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.119057:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55b800/0x962a5e377b33ab97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33ab9e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793924.119070:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788793924.119073:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788793924.119077:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788793924.119166:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.119175:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.119188:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793924.119235:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.119329:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793924.119390:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.119565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680128 00000100:00100000:3.0:1788793924.119576:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680128 00000100:00100000:3.0:1788793924.119673:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788793924.119694:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+13:6526:x1875685729680128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793924.119712:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793924.119727:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512200/0x962a5e377b33abac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33aba5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.119759:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512200/0x962a5e377b33abac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33aba5 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.119772:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512200/0x962a5e377b33abac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33aba5 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.119782:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512200, rc 0) 00000100:00100000:3.0:1788793924.119838:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4c2fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729680128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793924.119845:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788793924.120169:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793924.120197:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abac expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.120207:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33abac expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793924.120291:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.120326:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793924.120354:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af501ade3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793924.121930:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680256 00000100:00100000:1.0:1788793924.121947:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680256 00000100:00100000:1.0:1788793924.122035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788793924.122047:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729680256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793924.122320:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729680256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793924.122329:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788793924.122467:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.122531:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.122597:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.122650:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793924.123043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680384 00000100:00100000:1.0:1788793924.123050:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680384 00000100:00100000:1.0:1788793924.123212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788793924.123234:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729680384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793924.123352:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729680384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793924.123359:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788793924.123443:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788793924.127850:0:9836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:2.0:1788793924.128473:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788793924.128504:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788793924.128520:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abac expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.128535:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4fe55aa00/0x962a5e377b33aba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abac expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793924.128549:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793924.128553:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af501bb0000 from 42 10000000:01000000:2.0:1788793924.128556:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793924.128617:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.128646:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.128661:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793924.128694:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.128786:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.138154:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.140082:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680512 00000100:00100000:3.0:1788793924.140102:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680512 00000100:00100000:3.0:1788793924.140655:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788793924.140669:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+14:6526:x1875685729680512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793924.140702:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793924.140728:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512400/0x962a5e377b33abba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33abb3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.140764:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512400/0x962a5e377b33abba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33abb3 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.140777:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512400/0x962a5e377b33abba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33abb3 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.140815:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512400, rc 0) 00000100:00100000:3.0:1788793924.140922:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729680512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (12136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793924.140929:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788793924.141078:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793924.141101:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abba expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.141113:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33abba expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793924.141262:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.141306:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.141339:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.141415:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680640 00000100:00100000:3.0:1788793924.141421:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680640 00000100:00100000:3.0:1788793924.141458:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788793924.141465:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729680640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.141740:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729680640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793924.141748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788793924.142293:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.142339:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.142404:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.142480:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.144057:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680768 00000100:00100000:0.0:1788793924.144072:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680768 00000100:00100000:0.0:1788793924.144158:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788793924.144169:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729680768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.144379:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729680768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.144387:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788793924.146162:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788793924.147819:0:9837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:2.0:1788793924.148262:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:2.0:1788793924.148320:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788793924.148336:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abba expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.148351:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b61600/0x962a5e377b33abb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abba expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793924.148362:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788793924.148366:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788793924.148369:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788793924.148418:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.148427:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.148441:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793924.148474:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.148575:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.148632:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.148845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729680896 00000100:00100000:3.0:1788793924.148855:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729680896 00000100:00100000:3.0:1788793924.148916:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788793924.148928:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+15:6526:x1875685729680896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793924.148943:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793924.148960:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c1512600/0x962a5e377b33abc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33abc1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.148988:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c1512600/0x962a5e377b33abc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33abc1 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.149000:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c1512600/0x962a5e377b33abc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33abc1 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.149010:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c1512600, rc 0) 00000100:00100000:3.0:1788793924.149162:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729680896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793924.149170:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788793924.149393:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729680896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793924.149412:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abc8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.149423:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33abc8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793924.149491:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.149540:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.149582:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.149632:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681024 00000100:00100000:0.0:1788793924.149638:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681024 00000100:00100000:0.0:1788793924.149674:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788793924.149683:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729681024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.149837:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729681024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.149844:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788793924.150361:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.150397:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.150451:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.150480:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.151157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681152 00000100:00100000:3.0:1788793924.151165:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681152 00000100:00100000:1.0:1788793924.151305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788793924.151321:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729681152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.151650:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729681152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793924.151658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788793924.151847:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788793924.152891:0:9838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1788793924.153467:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788793924.153506:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788793924.153521:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abc8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.153537:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b61e00/0x962a5e377b33abc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abc8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793924.153549:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793924.153553:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9af4dfc78000 from 42 10000000:01000000:2.0:1788793924.153556:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793924.153614:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.153623:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.153635:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793924.153686:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.153759:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.153797:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.153950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681280 00000100:00100000:0.0:1788793924.153965:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681280 00000100:00100000:0.0:1788793924.154023:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788793924.154033:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+16:6526:x1875685729681280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793924.154048:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793924.154063:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55b200/0x962a5e377b33abd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33abcf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.154090:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55b200/0x962a5e377b33abd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33abcf expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.154101:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55b200/0x962a5e377b33abd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33abcf expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.154111:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55b200, rc 0) 00000100:00100000:0.0:1788793924.154185:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729681280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.154192:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788793924.154639:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793924.154658:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abd6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793924.154670:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33abd6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793924.154741:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.154779:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.154820:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.154952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681408 00000100:00100000:0.0:1788793924.154957:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681408 00000100:00100000:0.0:1788793924.154992:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788793924.155001:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729681408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.155172:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729681408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.155179:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788793924.155338:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.155369:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.155420:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.155478:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788793924.157846:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681536 00000100:00100000:3.0:1788793924.157866:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681536 00000100:00100000:2.0:1788793924.158974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788793924.159005:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729681536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.160877:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729681536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1878us (5443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793924.160895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788793924.161409:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788793924.162882:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:3.0:1788793924.167099:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:3.0:1788793924.167428:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788793924.167446:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abd6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.167461:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af501b60e00/0x962a5e377b33abcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abd6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793924.167475:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788793924.167478:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:3.0:1788793924.167481:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788793924.167532:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.167540:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.167553:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793924.167713:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.167809:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793924.167922:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.167969:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681664 00000100:00100000:0.0:1788793924.167981:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681664 00000100:00100000:0.0:1788793924.168228:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788793924.168239:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+17:6526:x1875685729681664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793924.168264:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793924.168280:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4fe55b000/0x962a5e377b33abe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33abdd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.168307:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4fe55b000/0x962a5e377b33abe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33abdd expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.168319:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4fe55b000/0x962a5e377b33abe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33abdd expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793924.168328:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4fe55b000, rc 0) 00000100:00100000:0.0:1788793924.168378:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729681664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.168384:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788793924.168461:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793924.168481:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abe4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.168490:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33abe4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793924.168558:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.168596:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793924.168930:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793924.168996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681792 00000100:00100000:2.0:1788793924.169003:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681792 00000100:00100000:2.0:1788793924.169636:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788793924.169656:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729681792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.169880:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729681792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793924.169888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788793924.170372:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.170501:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793924.170564:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.170635:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4f776ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.170677:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729681920 00000100:00100000:0.0:1788793924.170684:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729681920 00000100:00100000:0.0:1788793924.170759:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788793924.170768:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729681920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.170885:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4f9fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729681920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.170893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788793924.170965:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729681920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788793924.171952:0:9840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 64768 count 37 00000020:01000000:3.0:1788793924.172297:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-36 (rc=0) 10000000:01000000:3.0:1788793924.172325:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788793924.172338:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abe4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.172352:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1513e00/0x962a5e377b33abdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abe4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793924.172363:0:6526:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788793924.172367:0:6526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9af4ce6799e8 from 4 10000000:01000000:3.0:1788793924.172370:0:6526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788793924.172407:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.172417:0:6526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.172445:0:6526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793924.172467:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729682048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.172526:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.172842:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793924.172873:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729682048 00000100:00100000:1.0:1788793924.172881:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729682048 00000100:00100000:1.0:1788793924.172930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788793924.172939:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+18:6526:x1875685729682048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793924.172953:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793924.172968:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9af4c166b800/0x962a5e377b33abf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x962a5e377b33abeb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793924.172994:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9af4c166b800/0x962a5e377b33abf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x962a5e377b33abeb expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793924.173007:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9af4c166b800/0x962a5e377b33abf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x962a5e377b33abeb expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793924.173154:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9af4c166b800, rc 0) 00000100:00100000:1.0:1788793924.173208:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729682048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793924.173225:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788793924.173317:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729682048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793924.173333:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abf2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.173343:0:6526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x962a5e377b33abf2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793924.173405:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729682176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.173435:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793924.173452:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788793924.173539:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729682176 00000100:00100000:0.0:1788793924.173544:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729682176 00000100:00100000:0.0:1788793924.173575:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788793924.173582:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729682176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.173720:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729682176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793924.173739:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788793924.173805:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729682176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.173833:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729682304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793924.173872:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793924.173900:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793924.173939:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729682304 00000100:00100000:1.0:1788793924.173944:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729682304 00000100:00100000:1.0:1788793924.173962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788793924.173969:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729682304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793924.174079:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:6526:x1875685729682304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793924.174085:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788793924.174269:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:6526:1875685729682304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793924.174646:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4f78d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9841:1875685729682432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793924.174687:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793924.174719:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4fe5bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793924.174759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729682432 00000100:00100000:1.0:1788793924.174764:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729682432 00000100:00100000:1.0:1788793924.174796:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788793924.174803:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9841:x1875685729682432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793924.174906:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9841:x1875685729682432:12345-0@lo:502:llog_process_th.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793924.174920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788793924.174991:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4f78d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9841:1875685729682432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793924.175015:0:9841:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788793924.175038:0:9841:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793924.175041:0:9841:0:(obd_config.c:1547:class_process_config()) marker 29 (0x1) lustre srpc.flavor.default.cli2ost 00000020:00000080:3.0:1788793924.175053:0:9841:0:(obd_config.c:1456:class_process_config()) processing cmd: ce016 00000100:00100000:3.0:1788793924.175162:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9841:1875685729682560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793924.175198:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793924.175227:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9af4c60b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793924.175336:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729682560 00000100:00100000:1.0:1788793924.175340:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729682560 00000100:00100000:1.0:1788793924.175356:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788793924.175362:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9841:x1875685729682560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793924.175431:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2+19:9841:x1875685729682560:12345-0@lo:502:llog_process_th.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793924.175438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788793924.175499:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4ce4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d90946e9-48a2-4a27-88e6-1a1d8eafc0f2:9841:1875685729682560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793924.175517:0:9841:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788793924.175521:0:9841:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793924.175523:0:9841:0:(obd_config.c:1547:class_process_config()) marker 29 (0x2) lustre srpc.flavor.default.cli2ost 00000040:00080000:3.0:1788793924.175526:0:9841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:1.0:1788793924.175691:0:6526:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-sptlrpc gen 4-6 (rc=0) 10000000:01000000:1.0:1788793924.175770:0:6526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' succeeded (0). 00010000:00010000:1.0:1788793924.175780:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abf2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793924.175792:0:6526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9af4c1512e00/0x962a5e377b33abeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x962a5e377b33abf2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793924.939909:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793924.940838:0:3462:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788793924.947136:0:3462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9af4fabf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729682688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788793924.947263:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793924.947459:0:7520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685729682688 00000100:00100000:2.0:1788793924.947470:0:7520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685729682688 00000100:00080000:1.0:1788793924.947548:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788793924.947554:0:7520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788793924.947584:0:7520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729682688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788793924.951705:0:7520:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788793924.951841:0:7520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3462:x1875685729682688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4274us (4575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793924.951917:0:7520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788793924.952282:0:3462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9af4fabf3100 x1875685729682688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793924.952311:0:3462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9af4fabf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3462:1875685729682688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788793925.963585:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793926.987530:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793927.107646:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1788793927.107700:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1788793927.107967:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622400 00000100:00100000:2.0:1788793927.107976:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622400 00000100:00100000:2.0:1788793927.108049:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 261 00000100:00100000:2.0:1788793927.108059:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2373:x1875685707622400:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1788793927.108185:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2abe3cab-b632-4e65-86e0-311de8a706de+10:2373:x1875685707622400:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 127us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793927.108193:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 261 00000100:00100000:0.0:1788793927.109684:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622528 00000100:00100000:0.0:1788793927.109695:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622528 00000100:00100000:0.0:1788793927.109874:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1788793927.109884:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+6:2373:x1875685707622528:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1788793927.109956:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a13e557-9164-462f-8696-12fb9eb0378a+6:2373:x1875685707622528:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 74us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793927.109963:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00080000:1.0:1788793927.114237:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788793927.115813:0:3456:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1788793927.116156:0:7519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622656 00000100:00100000:1.0:1788793927.116173:0:7519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622656 00000100:00100000:1.0:1788793927.116310:0:7519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1788793927.116322:0:7519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4ce4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+5:2369:x1875685707622656:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:1.0:1788793927.116359:0:7519:0:(genops.c:1458:class_disconnect()) disconnect: cookie 0x962a5e377b33aa40 00000100:00080000:1.0:1788793927.116371:0:7519:0:(import.c:65:import_set_state_nolock()) ffff9af4fe566000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788793927.116415:0:7519:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788793927.116593:0:7519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4ce4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a13e557-9164-462f-8696-12fb9eb0378a+1:2369:x1875685707622656:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 273us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793927.116616:0:7519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000020:00000080:1.0:1788793927.116625:0:7519:0:(genops.c:885:class_export_put()) final put ffff9af4fe560800/0a13e557-9164-462f-8696-12fb9eb0378a 00010000:00010000:1.0:1788793927.116680:0:8595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788793927.116790:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9af4fe560800/0a13e557-9164-462f-8696-12fb9eb0378a for lustre-OST0000 00010000:00040000:1.0:1788793927.116802:0:38:0:(ldlm_lib.c:1799:target_destroy_export()) ASSERTION( atomic_read(&exp->exp_cb_count) == 0 ) failed: 00000100:00080000:0.0:1788793927.121953:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788793927.123031:0:3454:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1788793927.123313:0:8967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685707622784 00000100:00100000:0.0:1788793927.123325:0:8967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685707622784 00000100:00100000:0.0:1788793927.123397:0:8967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1788793927.123409:0:8967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9af4fabf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a13e557-9164-462f-8696-12fb9eb0378a+5:2369:x1875685707622784:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:0.0:1788793927.123444:0:8967:0:(genops.c:1458:class_disconnect()) disconnect: cookie 0x962a5e377b33aa47 00000100:00080000:0.0:1788793927.123455:0:8967:0:(import.c:65:import_set_state_nolock()) ffff9af4cdbef000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788793927.123500:0:8967:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788793927.123667:0:8967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9af4fabf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a13e557-9164-462f-8696-12fb9eb0378a+1:2369:x1875685707622784:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 259us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793927.123674:0:8967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000020:00000080:0.0:1788793927.123684:0:8967:0:(genops.c:885:class_export_put()) final put ffff9af4cdbea000/0a13e557-9164-462f-8696-12fb9eb0378a 00010000:00010000:0.0:1788793927.123769:0:6516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788793927.124170:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00040000:1.0:1788793927.134965:0:38:0:(ldlm_lib.c:1799:target_destroy_export()) LBUG Debug log: 8275 lines, 8275 kept, 0 dropped, 0 bad.