00000001:02000400:2.0F:1789760631.206550:0:3096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789760650.551898:0:3316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789760652.264947:0:3378:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 384 MB/s 00000001:01000000:0.0F:1789760652.516968:0:3378:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 450 MB/s 00000001:01000000:1.0F:1789760652.766445:0:3378:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2043 MB/s 00000020:02000000:3.0:1789760653.294438:0:3408:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g082f77f 00000400:02000000:0.0:1789760653.919837:0:3423:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:2.0:1789760657.121880:0:3572:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789760698.984601:0:5175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789760711.835440:0:5924:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789760711.835447:0:5924:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789760711.835449:0:5924:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789760711.835889:0:5924:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004a17657d 00000080:02000400:3.0:1789760711.835902:0:5924:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789760711.846409:0:5924:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789760711.846423:0:5924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789760711.846509:0:5924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009edf3988) 00000020:00000080:0.0:1789760711.846526:0:5924:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789760711.924825:0:5924:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789760711.924899:0:5924:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1789760711.948984:0:5924:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789760711.949201:0:5924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789760711.949209:0:5924:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789760711.949219:0:5924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c525ec 00000020:01000004:0.0:1789760711.949226:0:5924:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789760711.949231:0:5924:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789760711.949235:0:5924:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004a17657d from MGS 00000020:01000004:0.0:1789760711.949240:0:5924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789760711.949250:0:5924:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000727b3f9a) 00000020:00000080:0.0:1789760711.949259:0:5924:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789760711.949320:0:5924:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004a17657d from MGS, refs=2 00080000:01000000:0.0:1789760711.949325:0:5924:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789760711.949330:0:5924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c525fa 00000100:00100000:0.0:1789760711.949439:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789760711.949573:0:5924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789760711.949580:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789760711.950476:0:5924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789760711.950484:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789760711.951169:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760711.951353:0:5924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789760711.951358:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789760711.959211:0:5924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789760711.959273:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789760711.959990:0:5924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789760711.959999:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789760711.961268:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760711.961272:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760711.961274:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760711.961888:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760711.961891:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760711.961892:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760711.963207:0:5924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789760711.964239:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789760712.216490:0:5924:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2173 MB/s 00000001:01000000:3.0:1789760712.465915:0:5924:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3647 MB/s 00000001:01000000:0.0:1789760712.718258:0:5924:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 507 MB/s 00010000:00010000:3.0:1789760712.969193:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789760712.971371:0:5924:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 876 MB/s 00080000:10000000:2.0:1789760712.986410:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1789760713.004755:0:5924:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789760713.005978:0:5938:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789760713.006026:0:5924:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789760713.006076:0:5924:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789760713.006305:0:5924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789760713.006328:0:5924:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789760713.006839:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760713.006994:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789760713.007000:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789760713.007497:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789760713.007503:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789760713.007892:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789760713.007898:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789760713.009484:0:5924:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789760713.009514:0:5924:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1789760713.009516:0:5924:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789760713.009661:0:5924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1789760713.009682:0:5924:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (00000000c45bd9f1) 00000020:00000080:1.0:1789760713.009708:0:5924:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789760713.009950:0:5924:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000098cb859d@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1789760713.010102:0:5924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1789760713.010109:0:5924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789760713.010460:0:5942:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789760713.013291:0:5944:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789760713.013367:0:5924:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 586668c1-4957-4570-b773-2405a941ae03) 00000020:00000080:1.0:1789760713.014447:0:5924:0:(genops.c:1385:class_connect()) connect: client 586668c1-4957-4570-b773-2405a941ae03, cookie 0x1287b6a7b7c52608 00000100:00080000:1.0:1789760713.014461:0:5924:0:(import.c:510:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760713.014467:0:5924:0:(import.c:624:import_select_connection()) MGC192.168.203.113@tcp: import 0000000098cb859d using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1789760713.014512:0:5924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004354313f x1876700066480256/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789760713.014534:0:5924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 586668c1-4957-4570-b773-2405a941ae03->MGS 00000020:01000004:1.0:1789760713.014565:0:5924:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789760713.014571:0:5924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789760713.014584:0:5924:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000076aec9e9) 00000020:00000080:1.0:1789760713.014801:0:5924:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789760713.016820:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004354313f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:586668c1-4957-4570-b773-2405a941ae03:3438:1876700066480256:0@lo:250: 00000100:00100000:0.0:1789760713.018096:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.018185:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066480256 00000100:00100000:0.0:1789760713.018193:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066480256 00000100:00100000:0.0:1789760713.018222:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760713.018236:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b815f13f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3438:x1876700066480256:12345-0@lo:250: 00010000:00080000:0.0:1789760713.018262:0:5939:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 586668c1-4957-4570-b773-2405a941ae03@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1789760713.018362:0:5939:0:(genops.c:1385:class_connect()) connect: client 586668c1-4957-4570-b773-2405a941ae03, cookie 0x1287b6a7b7c52616 00000100:00080000:0.0:1789760713.018570:0:5939:0:(import.c:65:import_set_state_nolock()) 0000000095689900 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760713.018643:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b815f13f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+5:3438:x1876700066480256:12345-0@lo:250: Request processed in 406us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760713.018651:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760713.018715:0:3438:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789760713.018724:0:3438:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1789760713.018731:0:3438:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789760713.018735:0:3438:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789760713.018738:0:3438:0:(import.c:65:import_set_state_nolock()) 0000000098cb859d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789760713.018740:0:3438:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789760713.018749:0:3438:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789760713.018754:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004354313f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:586668c1-4957-4570-b773-2405a941ae03:3438:1876700066480256:0@lo:250: 00000100:00100000:1.0:1789760713.033668:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760713.035434:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789760713.035444:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789760713.041584:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789760713.041663:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789760713.046591:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789760713.046605:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789760713.048915:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760713.049103:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789760713.049109:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789760713.051061:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789760713.051075:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789760713.115934:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760713.116155:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789760713.116162:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789760713.119507:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789760713.119523:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789760713.120494:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760713.120661:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789760713.120667:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789760713.125645:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789760713.125658:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789760713.126449:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760713.126641:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789760713.126645:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789760713.127371:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789760713.127388:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789760713.128062:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760713.128247:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789760713.128253:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789760713.131158:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789760713.131172:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789760713.151500:0:5924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760713.151721:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789760713.151727:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789760713.154589:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789760713.154602:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789760713.155389:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789760713.155398:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789760713.156214:0:5924:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789760713.156244:0:5924:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789760713.156250:0:5924:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789760713.156345:0:5924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789760713.156388:0:5924:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789760713.156392:0:5924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789760713.156394:0:5924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760713.156395:0:5924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760713.156396:0:5924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760713.156397:0:5924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760713.156398:0:5924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760713.156399:0:5924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760713.156401:0:5924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760713.156402:0:5924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760713.156404:0:5924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760713.156406:0:5924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760713.156407:0:5924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789760713.156409:0:5924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789760713.156412:0:5924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789760713.156413:0:5924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789760713.156414:0:5924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760713.156415:0:5924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760713.156416:0:5924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760713.156417:0:5924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760713.156418:0:5924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789760713.156419:0:5924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789760713.156420:0:5924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760713.156421:0:5924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760713.156422:0:5924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760713.156422:0:5924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789760713.156464:0:5924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789760713.156481:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5347189 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480384:0@lo:253: 00000100:00100000:3.0:1789760713.156555:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760713.156653:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b56e9a0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.159548:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066480384 00000100:00100000:2.0:1789760713.159564:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066480384 00000100:00100000:2.0:1789760713.159736:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760713.159746:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009058cbeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+5:5924:x1876700066480384:12345-0@lo:253: 20000000:01000000:2.0:1789760713.159827:0:5941:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789760713.159829:0:5941:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789760713.160305:0:5962:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789760713.160368:0:5941:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789760713.160649:0:5941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760713.161654:0:5963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789760713.161894:0:5941:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789760713.161899:0:5941:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789760713.161914:0:5941:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789760713.161918:0:5941:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789760713.161930:0:5941:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789760713.162086:0:5941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760713.162253:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789760713.162266:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760713.162283:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789760713.162297:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789760713.162309:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789760713.162356:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789760713.162364:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789760713.162387:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789760713.162392:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789760713.162404:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789760713.162408:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789760713.162419:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789760713.162431:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789760713.162455:0:5941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789760713.162460:0:5941:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789760713.162467:0:5941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760713.162555:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789760713.162564:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789760713.162591:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789760713.162606:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789760713.162618:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789760713.162626:0:5941:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789760713.162650:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789760713.162657:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789760713.162669:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789760713.162690:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789760713.162704:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789760713.162712:0:5941:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789760713.162735:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789760713.162742:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789760713.162753:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789760713.162817:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789760713.162877:0:5941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789760713.162899:0:5941:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789760713.162906:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789760713.164150:0:5964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789760713.164363:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789760713.164412:0:5941:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:2.0:1789760713.164414:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1789760713.164432:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789760713.164438:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789760713.164462:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789760713.164468:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1789760713.164482:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789760713.164488:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789760713.164500:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789760713.164514:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789760713.164542:0:5941:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789760713.164545:0:5941:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789760713.164548:0:5941:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789760713.164605:0:5941:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789760713.164608:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789760713.165061:0:5965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789760713.165208:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789760713.165226:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789760713.165241:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789760713.165249:0:5941:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789760713.165250:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789760713.165598:0:5966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789760713.165719:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789760713.165736:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789760713.165748:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789760713.165795:0:5941:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789760713.165798:0:5941:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789760713.165802:0:5941:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789760713.165804:0:5941:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789760713.165809:0:5941:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789760713.165814:0:5941:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789760713.166190:0:5967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789760713.166280:0:5941:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789760713.180860:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789760713.180895:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789760713.180923:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789760713.181154:0:5941:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789760713.181175:0:5941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181192:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181202:0:5941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181209:0:5941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181215:0:5941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181221:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181227:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c53c4597 already unused, calling callback (000000001665e939) 00010000:00010000:2.0:1789760713.181230:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181237:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181248:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181255:0:5941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.181261:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c5261d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760713.181284:0:5941:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789760713.192555:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009058cbeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+5:5924:x1876700066480384:12345-0@lo:253: Request processed in 32803us (35992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760713.192575:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760713.194262:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5347189 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480384:0@lo:253: 10000000:01000000:0.0:1789760713.194280:0:5924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789760713.194283:0:5924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760713.194285:0:5924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789760713.194287:0:5924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760713.194288:0:5924:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789760713.194289:0:5924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760713.194290:0:5924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760713.194292:0:5924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760713.194293:0:5924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789760713.194309:0:5924:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789760713.194311:0:5924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760713.194312:0:5924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789760713.194333:0:5924:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004a17657d from lustre-MDT0000 10000000:01000000:0.0:1789760713.194364:0:5924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789760713.194367:0:5924:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789760713.194370:0:5924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa09c11ff0000 10000000:01000000:0.0:1789760713.194383:0:5924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760713.194391:0:5924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa09c11ff0000 from 1 10000000:01000000:0.0:1789760713.194394:0:5924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789760713.194445:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.194457:0:5924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.194466:0:5924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.194484:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079e1ece2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480512:0@lo:101: 00000100:00100000:0.0:1789760713.194537:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.194597:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7a3d9b7 going to sleep for 11 seconds 00000100:00100000:3.0:1789760713.194635:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066480512 00000100:00100000:3.0:1789760713.194642:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066480512 00000100:00100000:3.0:1789760713.194697:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760713.194706:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a987fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+5:5924:x1876700066480512:12345-0@lo:101: 00010000:00010000:3.0:1789760713.194720:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760713.194734:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52624 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.194754:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 6 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.194895:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 6 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.194905:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068998a50, rc 0) 00000100:00100000:3.0:1789760713.195064:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a987fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+6:5924:x1876700066480512:12345-0@lo:101: Request processed in 359us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760713.195077:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760713.197730:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079e1ece2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480512:0@lo:101: 00010000:00010000:2.0:1789760713.197756:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.198027:0:5924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760713.198135:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000777cba40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480640:0@lo:501: 00000100:00100000:2.0:1789760713.198191:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760713.198371:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a445d6f0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760713.204360:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066480640 00000100:00100000:3.0:1789760713.204383:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066480640 00000100:00100000:2.0:1789760713.204621:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760713.204632:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076076c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+6:5924:x1876700066480640:12345-0@lo:501: 00000100:00100000:2.0:1789760713.204788:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076076c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+6:5924:x1876700066480640:12345-0@lo:501: Request processed in 158us (6596us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760713.204795:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760713.204928:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000777cba40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480640:0@lo:501: 10000000:01000000:0.0:1789760713.204976:0:5924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789760713.204999:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.205010:0:5924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760713.205018:0:5924:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa09c1126a000 10000000:01000000:0.0:1789760713.205035:0:5924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789760713.205040:0:5924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa09c1126a000 10000000:01000000:0.0:1789760713.205043:0:5924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789760713.205047:0:5924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa09c1126a000 from 1 10000000:01000000:0.0:1789760713.205049:0:5924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789760713.205080:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.205088:0:5924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.205096:0:5924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.205113:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480768:0@lo:101: 00000100:00100000:0.0:1789760713.205150:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.205192:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb09d551 going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.205360:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066480768 00000100:00100000:2.0:1789760713.205365:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066480768 00000100:00100000:2.0:1789760713.205391:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760713.205397:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086b6c635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+6:5924:x1876700066480768:12345-0@lo:101: 00010000:00010000:2.0:1789760713.205406:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760713.205487:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c52639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52632 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.205509:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c52639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52632 expref: 7 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.205529:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c53c4597/0x1287b6a7b7c52639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52632 expref: 7 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.205537:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c53c4597, rc 0) 00000100:00100000:2.0:1789760713.205577:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086b6c635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+7:5924:x1876700066480768:12345-0@lo:101: Request processed in 180us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.205582:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760713.206033:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480768:0@lo:101: 00010000:00010000:0.0:1789760713.206046:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52639 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.206054:0:5924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52639 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760713.206067:0:5924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789760713.206119:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52639 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.206127:0:5924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000004207abc4/0x1287b6a7b7c52632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52639 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760713.206145:0:5924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789760713.206148:0:5924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760713.206153:0:5924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa09c1126a000 10000000:01000000:0.0:1789760713.206156:0:5924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789760713.206159:0:5924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789760713.206160:0:5924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760713.206176:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.206181:0:5924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.206188:0:5924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.206199:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480896:0@lo:101: 00000100:00100000:0.0:1789760713.206228:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.206258:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb09d551 going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.208190:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066480896 00000100:00100000:2.0:1789760713.208203:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066480896 00000100:00100000:2.0:1789760713.208270:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760713.208287:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051042884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+7:5924:x1876700066480896:12345-0@lo:101: 00010000:00010000:2.0:1789760713.208305:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760713.208320:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52640 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.208347:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 8 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.208358:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 8 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.208366:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a3e11de, rc 0) 00000100:00100000:2.0:1789760713.208455:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051042884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+8:5924:x1876700066480896:12345-0@lo:101: Request processed in 169us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.208461:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760713.208677:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066480896:0@lo:101: 00010000:00010000:0.0:1789760713.208694:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.208702:0:5924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.208857:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481024:0@lo:501: 00000100:00100000:0.0:1789760713.208895:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760713.209556:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481024 00000100:00100000:2.0:1789760713.209562:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481024 00000100:00100000:2.0:1789760713.209635:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760713.209650:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ede41a7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+8:5924:x1876700066481024:12345-0@lo:501: 00000100:00100000:2.0:1789760713.209780:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ede41a7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+9:5924:x1876700066481024:12345-0@lo:501: Request processed in 111us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.209787:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760713.216147:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb09d551 going to sleep for 11 seconds 00000100:00100000:0.0:1789760713.216194:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481024:0@lo:501: 00000100:00100000:0.0:1789760713.216250:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481152:0@lo:503: 00000100:00100000:0.0:1789760713.216458:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.216506:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb09d551 going to sleep for 11 seconds 00000100:00100000:1.0:1789760713.216650:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481152 00000100:00100000:1.0:1789760713.216657:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481152 00000100:00100000:1.0:1789760713.216708:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789760713.216716:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000761fd17c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+9:5924:x1876700066481152:12345-0@lo:503: 00000100:00100000:1.0:1789760713.217015:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000761fd17c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+9:5924:x1876700066481152:12345-0@lo:503: Request processed in 298us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760713.217023:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760713.217196:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481152:0@lo:503: 00000100:00100000:0.0:1789760713.217717:0:5968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5968:1876700066481280:0@lo:502: 00000100:00100000:0.0:1789760713.217788:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.217844:0:5968:0:(client.c:2715:ptlrpc_set_wait()) set 000000004291503e going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.217967:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481280 00000100:00100000:2.0:1789760713.217972:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481280 00000100:00100000:2.0:1789760713.218010:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760713.218018:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048182169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+9:5968:x1876700066481280:12345-0@lo:502: 00000100:00100000:2.0:1789760713.218114:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048182169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+9:5968:x1876700066481280:12345-0@lo:502: Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.218121:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760713.218305:0:5968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5968:1876700066481280:0@lo:502: 00000020:01000000:0.0:1789760713.218331:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760713.218345:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.218347:0:5968:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789760713.218352:0:5968:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789760713.218355:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760713.218368:0:5968:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000037f3dac8) 00000020:00000080:0.0:1789760713.218395:0:5968:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789760713.218402:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789760713.218498:0:5968:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789760713.218505:0:5968:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c52655 00000020:00000080:0.0:1789760713.218721:0:5968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789760713.218726:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760713.218729:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.218730:0:5968:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789760713.218733:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760713.218737:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.218738:0:5968:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789760713.218741:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760713.218748:0:5968:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009ad60d37) 00000020:00000080:0.0:1789760713.218785:0:5968:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789760713.218791:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789760713.218793:0:5968:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789760713.218796:0:5968:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789760713.218802:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789760713.219093:0:5968:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004a17657d from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789760713.219113:0:5968:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000000a6bfd0) 00000020:00000080:0.0:1789760713.219122:0:5968:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789760713.219176:0:5968:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789760713.219183:0:5968:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1287b6a7b7c5266a 00000020:00000080:0.0:1789760713.220563:0:5968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789760713.220576:0:5968:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789760713.220584:0:5968:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1287b6a7b7c52671 00080000:01000000:0.0:1789760713.220592:0:5968:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789760713.220596:0:5968:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c52678 00080000:10000000:0.0:1789760713.221673:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789760713.227371:0:5968:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789760713.250735:0:5968:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789760713.372852:0:5968:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789760713.373322:0:5968:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789760713.377128:0:5968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789760713.377654:0:5968:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789760713.385914:0:5968:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000584b46df) 00000020:00000080:2.0:1789760713.385939:0:5968:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789760713.386035:0:5968:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789760713.386043:0:5968:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c52686 00000020:00000080:2.0:1789760713.391565:0:5968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789760713.392509:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.416064:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.420455:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.437246:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789760713.444488:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789760713.448863:0:5968:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789760713.456085:0:5968:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1287b6a7b7c5268d 00000020:00000080:0.0:1789760713.456712:0:5968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789760713.456723:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760713.456729:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.456730:0:5968:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789760713.456733:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760713.456737:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.456738:0:5968:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760713.456741:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760713.456742:0:5968:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789760713.456745:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760713.456747:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.456748:0:5968:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789760713.456750:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760713.456754:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.456755:0:5968:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789760713.456759:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789760713.456822:0:5968:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789760713.456875:0:5968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5968:1876700066481408:0@lo:502: 00000100:00100000:0.0:1789760713.457291:0:5968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.457361:0:5968:0:(client.c:2715:ptlrpc_set_wait()) set 000000004291503e going to sleep for 11 seconds 00000100:00100000:1.0:1789760713.457552:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481408 00000100:00100000:1.0:1789760713.457561:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481408 00000100:00100000:1.0:1789760713.457608:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789760713.457616:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032ea728f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+9:5968:x1876700066481408:12345-0@lo:502: 00000100:00100000:1.0:1789760713.457732:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032ea728f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+9:5968:x1876700066481408:12345-0@lo:502: Request processed in 117us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760713.457740:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760713.457875:0:5968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5968:1876700066481408:0@lo:502: 00000020:01000000:0.0:1789760713.457901:0:5968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760713.457906:0:5968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760713.457909:0:5968:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789760713.457912:0:5968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789760713.458565:0:5924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789760713.458589:0:5924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789760713.458609:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.458621:0:5924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760713.458642:0:5924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09c1126a000 from 1 10000000:01000000:2.0:1789760713.458644:0:5924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760713.458675:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.458682:0:5924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.458691:0:5924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760713.458707:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040827646 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481536:0@lo:101: 00000100:00100000:2.0:1789760713.458744:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760713.458813:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 000000004222615f going to sleep for 11 seconds 00000100:00100000:3.0:1789760713.458941:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481536 00000100:00100000:3.0:1789760713.458947:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481536 00000100:00100000:3.0:1789760713.458984:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760713.458991:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de6d151f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+9:5924:x1876700066481536:12345-0@lo:101: 00010000:00010000:3.0:1789760713.459002:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760713.459014:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52694 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.459208:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.459218:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.459226:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000111da1d5, rc 0) 00000100:00100000:3.0:1789760713.459276:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de6d151f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:5924:x1876700066481536:12345-0@lo:101: Request processed in 278us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760713.459292:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760713.459423:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040827646 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481536:0@lo:101: 00010000:00010000:0.0:1789760713.459434:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.459443:0:5924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.460215:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481664:0@lo:256: 00000100:00100000:0.0:1789760713.460260:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760713.460349:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 000000004291503e going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.460414:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481664 00000100:00100000:2.0:1789760713.460419:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481664 00000100:00100000:2.0:1789760713.460459:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760713.460466:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9e52292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+10:5924:x1876700066481664:12345-0@lo:256: 20000000:01000000:2.0:1789760713.460483:0:5939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789760713.460489:0:5939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789760713.460543:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9e52292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+10:5924:x1876700066481664:12345-0@lo:256: Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.460549:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760713.460616:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481664:0@lo:256: 10000000:01000000:0.0:1789760713.461534:0:5924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760713.461556:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.461567:0:5924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760713.461574:0:5924:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c1126a000 from 1 10000000:01000000:0.0:1789760713.461576:0:5924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789760713.461606:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.462917:0:5924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.463208:0:5924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760713.463407:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481792:0@lo:101: 00000100:00100000:3.0:1789760713.463475:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760713.463513:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d74d1db going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.463564:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481792 00000100:00100000:2.0:1789760713.463571:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481792 00000100:00100000:2.0:1789760713.463621:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760713.463629:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000740d4ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+10:5924:x1876700066481792:12345-0@lo:101: 00010000:00010000:2.0:1789760713.463643:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760713.463670:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c526a2 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.463691:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.463700:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.463708:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002734b4c4, rc 0) 00000100:00100000:2.0:1789760713.463748:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000740d4ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:5924:x1876700066481792:12345-0@lo:101: Request processed in 119us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.463754:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760713.463866:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075246dd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481792:0@lo:101: 00010000:00010000:3.0:1789760713.463880:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760713.463887:0:5924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760713.463969:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481920:0@lo:501: 00000100:00100000:3.0:1789760713.463994:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760713.464132:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d74d1db going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.464217:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066481920 00000100:00100000:2.0:1789760713.464222:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066481920 00000100:00100000:2.0:1789760713.464251:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760713.464258:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053079b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:5924:x1876700066481920:12345-0@lo:501: 00000100:00100000:2.0:1789760713.464421:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053079b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:5924:x1876700066481920:12345-0@lo:501: Request processed in 164us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.464429:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760713.464573:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066481920:0@lo:501: 00000100:00100000:3.0:1789760713.464600:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482048:0@lo:503: 00000100:00100000:3.0:1789760713.464638:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760713.464659:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d74d1db going to sleep for 11 seconds 00000100:00100000:1.0:1789760713.464710:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482048 00000100:00100000:1.0:1789760713.464721:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482048 00000100:00100000:1.0:1789760713.464741:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789760713.464747:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c7085e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:5924:x1876700066482048:12345-0@lo:503: 00000040:00080000:1.0:1789760713.464806:0:5939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760713.464849:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c7085e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:5924:x1876700066482048:12345-0@lo:503: Request processed in 102us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760713.464855:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760713.465391:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482048:0@lo:503: 00000040:00080000:3.0:1789760713.466687:0:5972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789760713.467145:0:5924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789760713.467165:0:5924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760713.467185:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.467197:0:5924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760713.467247:0:5924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789760713.467249:0:5924:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa09c1126a000 10000000:01000000:1.0:1789760713.467252:0:5924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa09c1126a000 10000000:01000000:1.0:1789760713.467256:0:5924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760713.467261:0:5924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c1126a000 from 1 10000000:01000000:1.0:1789760713.467264:0:5924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760713.467398:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.467405:0:5924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.467414:0:5924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760713.467432:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000237203cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482176:0@lo:101: 00000100:00100000:1.0:1789760713.467511:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760713.467552:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d50f0f98 going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.467608:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482176 00000100:00100000:2.0:1789760713.467615:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482176 00000100:00100000:2.0:1789760713.467662:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760713.467672:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001fd097e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:5924:x1876700066482176:12345-0@lo:101: 00010000:00010000:2.0:1789760713.467684:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760713.467696:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c526b0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.467717:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 12 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.467734:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 12 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.467741:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024f61541, rc 0) 00000100:00100000:2.0:1789760713.467818:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001fd097e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482176:12345-0@lo:101: Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.467824:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760713.467939:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000237203cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482176:0@lo:101: 00010000:00010000:1.0:1789760713.467952:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.467960:0:5924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760713.468007:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000237203cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482304:0@lo:501: 00000100:00100000:1.0:1789760713.468144:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760713.468206:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d50f0f98 going to sleep for 11 seconds 00000100:00100000:0.0:1789760713.474307:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482304 00000100:00100000:0.0:1789760713.474322:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482304 00000100:00100000:0.0:1789760713.474395:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789760713.474404:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a9501d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482304:12345-0@lo:501: 00000100:00100000:0.0:1789760713.474575:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a9501d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482304:12345-0@lo:501: Request processed in 172us (6431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760713.474582:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760713.474803:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000237203cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482304:0@lo:501: 00000100:00100000:1.0:1789760713.474853:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000237203cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482432:0@lo:503: 00000100:00100000:1.0:1789760713.474905:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760713.474947:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d50f0f98 going to sleep for 11 seconds 00000100:00100000:3.0:1789760713.475104:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482432 00000100:00100000:3.0:1789760713.475110:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482432 00000100:00100000:3.0:1789760713.475142:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760713.475148:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c295b6f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482432:12345-0@lo:503: 00000100:00100000:3.0:1789760713.475244:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c295b6f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482432:12345-0@lo:503: Request processed in 96us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760713.475258:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760713.475440:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000237203cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482432:0@lo:503: 00000100:00100000:3.0:1789760713.476170:0:5973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5973:1876700066482560:0@lo:502: 00000100:00100000:3.0:1789760713.476223:0:5973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760713.476256:0:5973:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c31aabd9 going to sleep for 11 seconds 00000100:00100000:2.0:1789760713.476350:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482560 00000100:00100000:2.0:1789760713.476356:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482560 00000100:00100000:2.0:1789760713.476399:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760713.476406:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000771bc9c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5973:x1876700066482560:12345-0@lo:502: 00000100:00100000:2.0:1789760713.476495:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000771bc9c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5973:x1876700066482560:12345-0@lo:502: Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.476502:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760713.476611:0:5973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5973:1876700066482560:0@lo:502: 00000020:01000004:3.0:1789760713.476667:0:5973:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789760713.476690:0:5973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000060fc3155) 00000020:00000080:3.0:1789760713.476708:0:5973:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789760713.476869:0:5973:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004a17657d from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789760713.476873:0:5973:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004a17657d from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789760713.476875:0:5973:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004a17657d 4 00010000:00080000:3.0:1789760713.476904:0:5973:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000035813804@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1789760713.480756:0:5973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789760713.481791:0:5973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789760713.481838:0:5973:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789760713.481853:0:5973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1287b6a7b7c526c5 00000100:00080000:3.0:1789760713.481863:0:5973:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760713.481867:0:5973:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000035813804 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1789760713.481901:0:5973:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f1b71d2 x1876700066482688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760713.485572:0:5973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789760713.485808:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1876700066482688:0@lo:38: 00000100:00100000:1.0:1789760713.485879:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760713.487527:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482688 00000100:00100000:3.0:1789760713.487543:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482688 00000100:00100000:3.0:1789760713.487579:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760713.487586:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000237203cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1876700066482688:12345-0@lo:38: 00000100:00100000:3.0:1789760713.487672:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000237203cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1876700066482688:12345-0@lo:38: Request processed in 85us (1793us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789760713.487690:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760713.487856:0:5973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5973:1876700066482816:0@lo:502: 00000100:00100000:3.0:1789760713.487908:0:5973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760713.488065:0:3438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760713.488073:0:3438:0:(import.c:65:import_set_state_nolock()) 0000000035813804 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789760713.488077:0:3438:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789760713.488080:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f1b71d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1876700066482688:0@lo:38: 00000100:00100000:3.0:1789760713.488167:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482816 00000100:00100000:3.0:1789760713.488171:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482816 00000100:00100000:3.0:1789760713.488207:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760713.488214:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f51305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5973:x1876700066482816:12345-0@lo:502: 00000100:00100000:3.0:1789760713.488384:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f51305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5973:x1876700066482816:12345-0@lo:502: Request processed in 170us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760713.488391:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760713.488434:0:5973:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fa1be89 going to sleep for 11 seconds 00000100:00100000:3.0:1789760713.488448:0:5973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:5973:1876700066482816:0@lo:502: 00000040:00080000:3.0:1789760713.488467:0:5973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789760713.488612:0:5924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789760713.488631:0:5924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760713.488655:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.488666:0:5924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789760713.488711:0:5924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789760713.488713:0:5924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760713.488714:0:5924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760713.488715:0:5924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760713.488716:0:5924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760713.488717:0:5924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760713.488719:0:5924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760713.488720:0:5924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760713.488722:0:5924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760713.488723:0:5924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760713.488725:0:5924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760713.488726:0:5924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760713.488729:0:5924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789760713.488731:0:5924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760713.488732:0:5924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760713.488733:0:5924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760713.488734:0:5924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760713.488735:0:5924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760713.488736:0:5924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760713.488737:0:5924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760713.488738:0:5924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760713.488739:0:5924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760713.488739:0:5924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760713.488740:0:5924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760713.488741:0:5924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760713.488754:0:5924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789760713.488788:0:5924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004720ce26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482944:0@lo:253: 00000100:00100000:1.0:1789760713.488820:0:5924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760713.488837:0:5924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc856d70 going to sleep for 11 seconds 00000100:00100000:1.0:1789760713.488852:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066482944 00000100:00100000:1.0:1789760713.488856:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066482944 00000100:00100000:1.0:1789760713.488888:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760713.488893:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b6cc703 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482944:12345-0@lo:253: 20000000:01000000:1.0:1789760713.488915:0:5939:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789760713.488928:0:5939:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789760713.496341:0:5939:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789760713.496360:0:5939:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789760713.496456:0:5962:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789760713.496461:0:5962:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789760713.496480:0:5962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.496498:0:5962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.496506:0:5962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.496542:0:5962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.496558:0:5962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760713.496581:0:5962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009576a4e5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5962:1876700066483072:0@lo:104: 00000100:00100000:2.0:1789760713.496640:0:5962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760713.496693:0:5962:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c2f514f going to sleep for 11 seconds 00000100:00100000:1.0:1789760713.497245:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483072 00000100:00100000:1.0:1789760713.497253:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483072 00000100:00100000:1.0:1789760713.497294:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760713.497302:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065bd14d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5962:x1876700066483072:12345-0@lo:104: 00010000:00010000:1.0:1789760713.497313:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497367:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760713.497453:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065bd14d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5962:x1876700066483072:12345-0@lo:104: Request processed in 71us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760713.497461:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760713.497498:0:5962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009576a4e5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5962:1876700066483072:0@lo:104: 00010000:00010000:1.0:1789760713.497516:0:5962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497531:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760713.497535:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497542:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b9b9a88 already unused, calling callback (0000000063de9cff) 10000000:00010000:1.0:1789760713.497545:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497551:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760713.497570:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760713.497575:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760713.497604:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497610:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760713.497626:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497632:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000002b9b9a88/0x1287b6a7b7c52694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5269b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.497648:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760713.497649:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760713.497651:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760713.497688:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b6cc703 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:5924:x1876700066482944:12345-0@lo:253: Request processed in 8123us (8195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760713.497697:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760713.497808:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058633e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066483200:0@lo:103: 00000100:00100000:0.0:1789760713.497837:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760713.497977:0:5924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004720ce26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:5924:1876700066482944:0@lo:253: 10000000:01000000:2.0:1789760713.497987:0:5924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789760713.497990:0:5924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760713.497992:0:5924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789760713.497994:0:5924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760713.497995:0:5924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760713.497996:0:5924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760713.497997:0:5924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760713.497999:0:5924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760713.498000:0:5924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789760713.498002:0:5924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760713.498003:0:5924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760713.498005:0:5924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760713.498006:0:5924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789760713.498445:0:5924:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789760713.499256:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483200 00000100:00100000:1.0:1789760713.499266:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483200 00010000:00010000:1.0:1789760713.499300:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760713.499335:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760713.499343:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e16cab9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+12:3440:x1876700066483200:12345-0@lo:103: 00010000:00010000:1.0:1789760713.499354:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760713.499359:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.499369:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.500310:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000111da1d5/0x1287b6a7b7c5269b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52694 expref: 12 pid: 5941 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.500326:0:5932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.500333:0:5932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760713.500348:0:5932:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003887877s 00010000:00010000:1.0:1789760713.500352:0:5932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.500358:0:5932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.500362:0:5932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.500368:0:5932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.504936:0:5932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000041b2d51e already unused, calling callback (000000001665e939) 00010000:00010000:1.0:1789760713.504943:0:5932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.504954:0:5932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.504986:0:5932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.505029:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760713.505111:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e16cab9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+11:3440:x1876700066483200:12345-0@lo:103: Request processed in 5765us (7270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760713.505121:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760713.506210:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058633e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066483200:0@lo:103: 00010000:00010000:0.0:1789760713.506318:0:5962:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.506329:0:5962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.506335:0:5962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041b2d51e/0x1287b6a7b7c526cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789760713.513567:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.513731:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789760713.513993:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.514512:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789760713.514711:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.516626:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789760713.522889:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.523096:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789760713.523298:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.523473:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789760713.523692:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789760713.523883:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789760713.528425:0:5924:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789760713.557106:0:5924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789760713.557139:0:5978:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789760713.557144:0:5978:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789760713.557514:0:5979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789760713.565542:0:5924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789760713.565669:0:5924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789760713.567251:0:5924:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789760713.567268:0:5924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789760713.567458:0:5924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760713.570466:0:5924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789760713.572525:0:5924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789760713.572587:0:5924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789760713.575983:0:5924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789760713.576329:0:5924:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1789760713.577529:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789760713.577670:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:1.0:1789760713.577979:0:5979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1789760713.578353:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000040:00080000:1.0:1789760713.585961:0:5979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789760713.586058:0:5979:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789760713.586063:0:5979:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1789760713.590231:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789760713.591199:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789760713.591369:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789760713.592559:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789760713.592728:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789760713.593158:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789760713.593323:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789760713.595561:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789760713.595748:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789760713.596189:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789760713.596330:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789760713.597723:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789760713.598702:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789760713.600088:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789760713.600290:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789760713.601153:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789760713.601368:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789760713.604477:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789760713.604881:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789760713.605022:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789760713.605158:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789760713.605579:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789760713.605743:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789760713.605984:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789760713.606147:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789760713.606324:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789760713.606508:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789760713.606669:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789760713.608633:0:5924:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789760713.608931:0:5924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789760713.620149:0:5924:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789760713.620194:0:5924:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbed6c1c7f988 00100000:10000000:0.0:1789760713.620219:0:5924:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789760713.623484:0:5924:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789760713.623503:0:5924:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789760713.623523:0:5924:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789760713.623542:0:5924:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789760713.624348:0:5924:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789760713.624528:0:5924:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789760713.993850:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760715.021056:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760716.041836:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760717.065005:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760718.094640:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760718.298208:0:6224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789760718.987405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789760718.987416:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789760718.987418:0:36:0:(import.c:65:import_set_state_nolock()) 0000000035813804 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789760718.987441:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000035813804 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1789760718.987462:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aac099f6 x1876700066483456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760718.987500:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aac099f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1876700066483456:0@lo:38: 00000100:00100000:1.0:1789760718.987562:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760718.987807:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef655286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066483328:0@lo:400: 00000100:00100000:2.0:1789760718.987843:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760718.988042:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483328 00000100:00100000:1.0:1789760718.988050:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483328 00000100:00100000:0.0:1789760718.988089:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483456 00000100:00100000:0.0:1789760718.988094:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483456 00000100:00100000:1.0:1789760718.988098:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760718.988107:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061be308b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:3441:x1876700066483328:12345-0@lo:400: 00000100:00100000:0.0:1789760718.988116:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760718.988119:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031d9f114 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1876700066483456:12345-0@lo:38: 00010000:00080000:0.0:1789760718.988136:0:5948:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000100:00100000:1.0:1789760718.988154:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061be308b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:3441:x1876700066483328:12345-0@lo:400: Request processed in 48us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760718.988160:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:0.0:1789760718.988179:0:5948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1287b6a7b7c526d3 00000100:00100000:1.0:1789760718.988200:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef655286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066483328:0@lo:400: 00000004:00100000:0.0:1789760718.988216:0:5948:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789760718.988328:0:5948:0:(import.c:65:import_set_state_nolock()) 00000000ec9bb80f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760718.988387:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031d9f114 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3438:x1876700066483456:12345-0@lo:38: Request processed in 267us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760718.988402:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789760718.989809:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aac099f6 x1876700066483456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789760718.989827:0:3438:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789760718.989835:0:3438:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789760718.989840:0:3438:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760718.989842:0:3438:0:(import.c:65:import_set_state_nolock()) 0000000035813804 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789760718.989859:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aac099f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1876700066483456:0@lo:38: 00010000:00010000:2.0:1789760719.113994:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789760719.242211:0:6276:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760719.242384:0:6276:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789760720.138204:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760721.161010:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789760721.943248:0:6377:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789760721.943455:0:6377:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789760722.056975:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789760722.056982:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09c1126a000 from 3 10000000:01000000:1.0:1789760722.056986:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789760722.057022:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.057031:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.057038:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.057056:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aac099f6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066483584:0@lo:101: 00000100:00100000:1.0:1789760722.057108:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760722.057148:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036d909fd going to sleep for 11 seconds 00000100:00100000:0.0:1789760722.057209:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483584 00000100:00100000:0.0:1789760722.057217:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483584 00000100:00100000:1.0:1789760722.057299:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760722.057322:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017ba3796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:5944:x1876700066483584:12345-0@lo:101: 00010000:00010000:1.0:1789760722.057335:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760722.057346:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d95cb2df/0x1287b6a7b7c526e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c526da expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.057367:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d95cb2df/0x1287b6a7b7c526e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 12 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.057376:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d95cb2df/0x1287b6a7b7c526e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 12 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.057385:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d95cb2df, rc 0) 00000100:00100000:1.0:1789760722.057443:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017ba3796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066483584:12345-0@lo:101: Request processed in 136us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760722.057450:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760722.057834:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aac099f6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066483584:0@lo:101: 00010000:00010000:3.0:1789760722.057849:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.057858:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760722.057928:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066483712:0@lo:256: 00000100:00100000:3.0:1789760722.057961:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760722.057990:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set 00000000507f779f going to sleep for 11 seconds 00000100:00100000:1.0:1789760722.058004:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483712 00000100:00100000:1.0:1789760722.058010:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483712 00000100:00100000:1.0:1789760722.058044:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760722.058052:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092eb7d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066483712:12345-0@lo:256: 20000000:01000000:1.0:1789760722.058066:0:5941:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789760722.058079:0:5941:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789760722.058082:0:5941:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789760722.058167:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092eb7d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066483712:12345-0@lo:256: Request processed in 116us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760722.058173:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760722.059038:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066483712:0@lo:256: 10000000:01000000:3.0:1789760722.059086:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789760722.059092:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.059101:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000013f3a56b/0x1287b6a7b7c526da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.186133:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789760722.684684:0:6426:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde416da60 20000000:00000080:1.0:1789760722.684702:0:6426:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa09c3531bc00 uarg=0000000000000000 20000000:01000000:1.0:1789760722.684740:0:6426:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789760722.684748:0:6426:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789760722.684753:0:6426:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789760722.684948:0:6426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789760722.684958:0:6426:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789760722.691284:0:6426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760722.691554:0:6426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789760722.691586:0:6426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789760722.691601:0:6426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789760722.691616:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789760722.691631:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.691647:0:6426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.691666:0:6426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.691703:0:6426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.691717:0:6426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 11 pid: 5939 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.691731:0:6426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef655286 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6426:1876700066483840:0@lo:104: 00000100:00100000:1.0:1789760722.692603:0:6426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760722.692686:0:6426:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063772277 going to sleep for 11 seconds 00000100:00100000:0.0:1789760722.693022:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483840 00000100:00100000:0.0:1789760722.693031:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483840 00000100:00100000:0.0:1789760722.693089:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760722.693098:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007791fbe5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+3:6426:x1876700066483840:12345-0@lo:104: 00010000:00010000:0.0:1789760722.693111:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.693190:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760722.693196:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007791fbe5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+3:6426:x1876700066483840:12345-0@lo:104: Request processed in 100us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760722.693204:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789760722.693226:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760722.693231:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.693238:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000042176171 already unused, calling callback (0000000063de9cff) 10000000:00010000:0.0:1789760722.693242:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.693253:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760722.693259:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760722.693263:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789760722.693291:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.693297:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760722.693325:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.693330:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000042176171/0x1287b6a7b7c526a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526a9 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760722.693357:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760722.693359:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760722.693360:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760722.693375:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acfc31ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066483968:0@lo:103: 00000100:00100000:0.0:1789760722.693408:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760722.693485:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066483968 00000100:00100000:3.0:1789760722.693490:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066483968 00010000:00010000:3.0:1789760722.693508:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 12 pid: 5939 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760722.693535:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760722.693540:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaa4554a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+12:3442:x1876700066483968:12345-0@lo:103: 00010000:00010000:3.0:1789760722.693549:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760722.693553:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 12 pid: 5939 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693561:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 12 pid: 5939 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693577:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693589:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693602:0:5933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693608:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693613:0:5933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693618:0:5933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693623:0:5933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000917e358 already unused, calling callback (000000001665e939) 00010000:00010000:3.0:1789760722.693626:0:5933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693632:0:5933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693639:0:5933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693647:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760722.693676:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaa4554a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+12:3442:x1876700066483968:12345-0@lo:103: Request processed in 137us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760722.693682:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789760722.693726:0:6426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002734b4c4/0x1287b6a7b7c526a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c526a2 expref: 11 pid: 5939 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760722.693741:0:6426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef655286 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6426:1876700066483840:0@lo:104: 00010000:00010000:3.0:1789760722.693756:0:6426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693787:0:6426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693792:0:6426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760722.693798:0:6426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000917e358/0x1287b6a7b7c526e8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760722.694722:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acfc31ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066483968:0@lo:103: 00010000:00010000:3.0:1789760723.209124:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760724.106143:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066484096:0@lo:400: 00000100:00100000:1.0:1789760724.106241:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760724.106316:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760724.106321:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b241fafe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066484224:0@lo:400: 00000100:00100000:1.0:1789760724.106352:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760724.106552:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484224 00000100:00100000:1.0:1789760724.106562:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484224 00000100:00100000:1.0:1789760724.106615:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760724.106624:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030d5145c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066484224:12345-0@lo:400: 00000100:00100000:1.0:1789760724.106682:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030d5145c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066484224:12345-0@lo:400: Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760724.106689:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789760724.106736:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b241fafe x1876700066484224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760724.106751:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b241fafe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066484224:0@lo:400: 00000100:00100000:3.0:1789760724.106883:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484096 00000100:00100000:3.0:1789760724.106888:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484096 00000100:00100000:3.0:1789760724.106929:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760724.106936:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd71c942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:3439:x1876700066484096:12345-0@lo:400: 00000100:00100000:3.0:1789760724.106974:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd71c942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:3439:x1876700066484096:12345-0@lo:400: Request processed in 40us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760724.106980:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760724.107017:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066484096:0@lo:400: 00010000:00010000:0.0:1789760724.232880:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760725.256963:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760726.283395:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760727.305056:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760728.328924:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760729.225671:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072b7ff16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066484352:0@lo:400: 00000100:00100000:0.0:1789760729.225755:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760729.225829:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484352 00000100:00100000:1.0:1789760729.225839:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484352 00000100:00100000:0.0:1789760729.225868:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760729.225876:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bac95be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1876700066484480:0@lo:400: 00000100:00100000:1.0:1789760729.225889:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760729.225899:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0f9c2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:3441:x1876700066484352:12345-0@lo:400: 00000100:00100000:0.0:1789760729.225913:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760729.225946:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484480 00000100:00100000:0.0:1789760729.225950:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484480 00000100:00100000:0.0:1789760729.225982:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760729.225988:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acfc31ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1876700066484480:12345-0@lo:400: 00000100:00100000:0.0:1789760729.226041:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acfc31ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1876700066484480:12345-0@lo:400: Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760729.226051:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0f9c2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:3441:x1876700066484352:12345-0@lo:400: Request processed in 151us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760729.226052:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760729.226063:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789760729.226101:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000bac95be x1876700066484480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760729.226116:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bac95be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1876700066484480:0@lo:400: 00000100:00100000:0.0:1789760729.226126:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072b7ff16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066484352:0@lo:400: 00010000:00010000:2.0:1789760729.359187:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760730.376899:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789760730.923634:0:6924:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789760730.923638:0:6924:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789760730.923639:0:6924:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789760730.923793:0:6924:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a1c9e908 00000020:01000004:0.0:1789760730.924264:0:6924:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789760730.924276:0:6924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789760730.924291:0:6924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000009b47ffe2) 00000020:00000080:0.0:1789760730.924306:0:6924:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789760730.966686:0:6924:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789760730.966743:0:6924:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789760731.006822:0:6924:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789760731.007015:0:6924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789760731.007024:0:6924:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789760731.007035:0:6924:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1287b6a7b7c526f6 00000020:01000004:0.0:1789760731.007041:0:6924:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789760731.007059:0:6924:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789760731.007062:0:6924:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789760731.007067:0:6924:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789760731.007072:0:6924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789760731.007081:0:6924:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000b73f86d4) 00000020:00000080:0.0:1789760731.007091:0:6924:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789760731.012058:0:6924:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760731.012231:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789760731.012237:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789760731.017687:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789760731.017700:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789760731.018289:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789760731.018296:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789760731.021443:0:6924:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760731.021760:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789760731.021781:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789760731.024716:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789760731.024728:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789760731.046717:0:6924:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760731.047172:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789760731.047179:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789760731.048429:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789760731.048440:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789760731.050480:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789760731.050496:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789760731.053353:0:6924:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760731.053560:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789760731.053566:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789760731.054344:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789760731.054352:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789760731.087101:0:6924:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760731.087311:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789760731.087324:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789760731.089511:0:6924:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789760731.089526:0:6924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789760731.091132:0:6924:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789760731.091162:0:6924:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789760731.091169:0:6924:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789760731.112601:0:6924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789760731.112637:0:6924:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789760731.112641:0:6924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789760731.112643:0:6924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760731.112644:0:6924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760731.112645:0:6924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760731.112646:0:6924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760731.112647:0:6924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760731.112648:0:6924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760731.112650:0:6924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760731.112651:0:6924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760731.112652:0:6924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760731.112654:0:6924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789760731.112657:0:6924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789760731.112660:0:6924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789760731.112662:0:6924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760731.112663:0:6924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760731.112663:0:6924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760731.112664:0:6924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760731.112666:0:6924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760731.112666:0:6924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760731.112668:0:6924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760731.112668:0:6924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760731.112669:0:6924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760731.112670:0:6924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789760731.112711:0:6924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789760731.112732:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000137ee236 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066484608:0@lo:253: 00000100:00100000:0.0:1789760731.112826:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.113264:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054d51a18 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.113382:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484608 00000100:00100000:1.0:1789760731.113399:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484608 00000100:00100000:1.0:1789760731.113445:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760731.113454:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0e712f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066484608:12345-0@lo:253: 20000000:01000000:1.0:1789760731.113483:0:5939:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789760731.113487:0:5939:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789760731.113492:0:5939:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789760731.113495:0:5939:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789760731.113712:0:5939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760731.113882:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789760731.113897:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789760731.113915:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789760731.113922:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789760731.113934:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789760731.113951:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789760731.114046:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789760731.114063:0:5939:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1789760731.114065:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1789760731.114081:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789760731.114088:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760731.114103:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789760731.114109:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1789760731.114122:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789760731.114128:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760731.114140:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789760731.114155:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789760731.115918:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789760731.115945:0:5939:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1789760731.115947:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1789760731.115965:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789760731.115974:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760731.115990:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789760731.115996:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1789760731.116012:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789760731.116019:0:5939:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760731.116033:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789760731.116049:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789760731.116063:0:5939:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789760731.116066:0:5939:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789760731.116070:0:5939:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789760731.116130:0:5939:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789760731.116133:0:5939:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789760731.117808:0:6943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789760731.118028:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789760731.118055:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789760731.118070:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789760731.118081:0:5939:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760731.118083:0:5939:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789760731.118487:0:6944:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789760731.118509:0:6944:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789760731.118525:0:6944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789760731.118740:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789760731.118808:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789760731.118827:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789760731.118838:0:5939:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789760731.118840:0:5939:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789760731.119457:0:6945:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789760731.119476:0:6945:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789760731.119490:0:6945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789760731.119954:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789760731.119977:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789760731.120011:0:5939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1789760731.120029:0:5939:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789760731.120045:0:5939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120063:0:5939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 11 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120070:0:5939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120076:0:5939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120082:0:5939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120116:0:5939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120127:0:5939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 11 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.120141:0:5939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001054a04c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5939:1876700066484736:0@lo:104: 00000100:00100000:0.0:1789760731.120200:0:5939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760731.120265:0:5939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.120273:0:5939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 11 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.120378:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484736 00000100:00100000:2.0:1789760731.120386:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484736 00000100:00100000:2.0:1789760731.120427:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760731.120435:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086adcd13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5939:x1876700066484736:12345-0@lo:104: 00010000:00010000:2.0:1789760731.120446:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.120503:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760731.120508:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086adcd13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5939:x1876700066484736:12345-0@lo:104: Request processed in 75us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.120515:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789760731.120585:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760731.120596:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.120603:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073a24503 already unused, calling callback (0000000063de9cff) 10000000:00010000:3.0:1789760731.120606:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.120613:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760731.120619:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760731.120625:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760731.120659:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.120666:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760731.120684:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.120690:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000073a24503/0x1287b6a7b7c526b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526b7 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.120703:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760731.120705:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760731.120706:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760731.120717:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066484992:0@lo:103: 00000100:00100000:3.0:1789760731.120746:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.120808:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484992 00000100:00100000:3.0:1789760731.120812:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484992 00010000:00010000:3.0:1789760731.120836:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 12 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.120858:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760731.120863:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ad1b838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+12:3439:x1876700066484992:12345-0@lo:103: 00010000:00010000:3.0:1789760731.120873:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760731.120876:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 12 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.121016:0:5939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000abf3da92 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5939:1876700066484864:0@lo:104: 00000100:00100000:0.0:1789760731.121047:0:5939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.121102:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066484864 00000100:00100000:2.0:1789760731.121106:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066484864 00000100:00100000:2.0:1789760731.121133:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760731.121139:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a1b467 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5939:x1876700066484864:12345-0@lo:104: 00010000:00010000:2.0:1789760731.121146:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.121178:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760731.121182:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a1b467 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5939:x1876700066484864:12345-0@lo:104: Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.121188:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789760731.123083:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760731.123093:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.123105:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004619de1e already unused, calling callback (0000000063de9cff) 10000000:00010000:1.0:1789760731.123108:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.123117:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760731.123123:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760731.123129:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760731.123180:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.123187:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760731.123206:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.123212:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000004619de1e/0x1287b6a7b7c52640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.123254:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760731.123256:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760731.123257:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760731.124608:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 12 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.124637:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760731.124717:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ad1b838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+12:3439:x1876700066484992:12345-0@lo:103: Request processed in 3853us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.124728:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760731.124800:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cdcc19d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066485120:0@lo:103: 00000100:00100000:3.0:1789760731.124836:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.124891:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066484992:0@lo:103: 00000100:00100000:1.0:1789760731.125178:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485120 00000100:00100000:1.0:1789760731.125185:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485120 00010000:00010000:1.0:1789760731.125214:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 12 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.125254:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760731.125261:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b645e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+12:3440:x1876700066485120:12345-0@lo:103: 00010000:00010000:1.0:1789760731.125273:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760731.125277:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 12 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.125296:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 12 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.125308:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760731.125342:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b645e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+12:3440:x1876700066485120:12345-0@lo:103: Request processed in 83us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.125349:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760731.125447:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cdcc19d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066485120:0@lo:103: 00010000:00010000:0.0:1789760731.125758:0:5939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 11 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.125798:0:5939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 11 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.125810:0:5939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032da66bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5939:1876700066485248:0@lo:104: 00000100:00100000:0.0:1789760731.125842:0:5939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.125874:0:5939:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e211f3c7 going to sleep for 11 seconds 00010000:00010000:0.0:1789760731.125888:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000024f61541/0x1287b6a7b7c526b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c526b0 expref: 11 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.125901:0:5939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001054a04c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5939:1876700066484736:0@lo:104: 00010000:00010000:0.0:1789760731.125909:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a3e11de/0x1287b6a7b7c52647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52640 expref: 10 pid: 5939 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.125916:0:5939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000abf3da92 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5939:1876700066484864:0@lo:104: 00000100:00100000:1.0:1789760731.126076:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485248 00000100:00100000:1.0:1789760731.126081:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485248 00000100:00100000:1.0:1789760731.126119:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760731.126126:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6bae74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5939:x1876700066485248:12345-0@lo:104: 00010000:00010000:1.0:1789760731.126136:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.126199:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760731.126204:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6bae74c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5939:x1876700066485248:12345-0@lo:104: Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.126210:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789760731.126266:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760731.126272:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126349:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c592ff9 already unused, calling callback (0000000063de9cff) 10000000:00010000:3.0:1789760731.126354:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126372:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760731.126378:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760731.126382:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760731.126415:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126422:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760731.126437:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126442:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000007c592ff9/0x1287b6a7b7c52624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5262b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126456:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760731.126457:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760731.126459:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760731.126469:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066485376:0@lo:103: 00000100:00100000:3.0:1789760731.126502:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.126533:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485376 00000100:00100000:3.0:1789760731.126537:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485376 00010000:00010000:3.0:1789760731.126551:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 10 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.126572:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760731.126578:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005828d130 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+10:3441:x1876700066485376:12345-0@lo:103: 00010000:00010000:3.0:1789760731.126593:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760731.126597:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 10 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126606:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 10 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126619:0:5932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126626:0:5932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126638:0:5932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126645:0:5932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126651:0:5932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126656:0:5932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126660:0:5932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000238fb4c7 already unused, calling callback (000000001665e939) 00010000:00010000:3.0:1789760731.126663:0:5932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126669:0:5932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126685:0:5932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126695:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760731.126723:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005828d130 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+10:3441:x1876700066485376:12345-0@lo:103: Request processed in 146us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.126730:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760731.126754:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066485376:0@lo:103: 00010000:00010000:3.0:1789760731.126802:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068998a50/0x1287b6a7b7c5262b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52624 expref: 9 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.126811:0:5939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032da66bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5939:1876700066485248:0@lo:104: 00010000:00010000:3.0:1789760731.126828:0:5939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126834:0:5939:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126838:0:5939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.126843:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000238fb4c7/0x1287b6a7b7c52704 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789760731.126852:0:5939:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789760731.129503:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0e712f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+8:6924:x1876700066484608:12345-0@lo:253: Request processed in 16042us (16669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.129516:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760731.129608:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000137ee236 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066484608:0@lo:253: 10000000:01000000:1.0:1789760731.129622:0:6924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789760731.129625:0:6924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760731.129627:0:6924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789760731.129628:0:6924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760731.129629:0:6924:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789760731.129631:0:6924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760731.129632:0:6924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760731.129634:0:6924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760731.129635:0:6924:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789760731.129636:0:6924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760731.129638:0:6924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789760731.129656:0:6924:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a1c9e908 from lustre-OST0000 10000000:01000000:1.0:1789760731.129928:0:6924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789760731.129931:0:6924:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789760731.129937:0:6924:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa09c11ff0000 local copy 10000000:01000000:1.0:1789760731.129941:0:6924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760731.129974:0:6924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.129983:0:6924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.129992:0:6924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.130007:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a3db786 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066485504:0@lo:101: 00000100:00100000:1.0:1789760731.130054:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.130131:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be81b754 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.130167:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485504 00000100:00100000:2.0:1789760731.130175:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485504 00000100:00100000:2.0:1789760731.130254:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789760731.130264:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e9039e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+8:6924:x1876700066485504:12345-0@lo:101: 00010000:00010000:2.0:1789760731.130276:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760731.130359:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000faa63906/0x1287b6a7b7c52712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5270b expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.130381:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000faa63906/0x1287b6a7b7c52712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5270b expref: 9 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.130391:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000faa63906/0x1287b6a7b7c52712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5270b expref: 9 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.130399:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000faa63906, rc 0) 00000100:00100000:2.0:1789760731.130438:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e9039e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+9:6924:x1876700066485504:12345-0@lo:101: Request processed in 176us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.130445:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760731.130512:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a3db786 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066485504:0@lo:101: 00010000:00010000:0.0:1789760731.130523:0:6924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.130531:0:6924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.130614:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066485632:0@lo:501: 00000100:00100000:0.0:1789760731.130645:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.130744:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d0725e3 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.130803:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485632 00000100:00100000:1.0:1789760731.130807:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485632 00000100:00100000:1.0:1789760731.130827:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760731.130832:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daa6c7a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+9:6924:x1876700066485632:12345-0@lo:501: 00000100:00100000:1.0:1789760731.130888:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daa6c7a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+9:6924:x1876700066485632:12345-0@lo:501: Request processed in 55us (242us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760731.130895:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789760731.130948:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066485632:0@lo:501: 10000000:01000000:0.0:1789760731.130960:0:6924:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789760731.130974:0:6924:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789760731.130978:0:6924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.130985:0:6924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.130991:0:6924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131011:0:6924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789760731.131028:0:6924:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa09c05703000 10000000:01000000:0.0:1789760731.131032:0:6924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789760731.131035:0:6924:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa09c11ff0000 10000000:01000000:0.0:1789760731.131037:0:6924:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789760731.131040:0:6924:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa09c11ff0000 from 1 10000000:01000000:0.0:1789760731.131042:0:6924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789760731.131055:0:6924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131061:0:6924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131067:0:6924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.131088:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066485760:0@lo:101: 00000100:00100000:0.0:1789760731.131112:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.131130:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d9e58b2 going to sleep for 11 seconds 00010000:00010000:1.0:1789760731.131170:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760731.131174:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131181:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000239b485b already unused, calling callback (0000000063de9cff) 10000000:00010000:1.0:1789760731.131184:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131190:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760731.131196:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760731.131202:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760731.131219:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131225:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760731.131255:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131270:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c5270b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1287b6a7b7c52712 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131292:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760731.131294:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760731.131296:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760731.131304:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485760 00000100:00100000:1.0:1789760731.131308:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485760 00000100:00100000:1.0:1789760731.131323:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760731.131328:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb8e58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+9:6924:x1876700066485760:12345-0@lo:101: 00010000:00010000:1.0:1789760731.131335:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760731.131342:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000affce8b2/0x1287b6a7b7c52720 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52719 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131354:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000affce8b2/0x1287b6a7b7c52720 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52719 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131361:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000affce8b2/0x1287b6a7b7c52720 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52719 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.131366:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000affce8b2, rc 0) 00000100:00100000:1.0:1789760731.131389:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb8e58a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066485760:12345-0@lo:101: Request processed in 61us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.131394:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760731.131503:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c465195a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066485888:0@lo:103: 00000100:00100000:0.0:1789760731.131529:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.131578:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066485760:0@lo:101: 00010000:00010000:0.0:1789760731.131587:0:6924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52720 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131594:0:6924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52720 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760731.131607:0:6924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789760731.131614:0:6924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52720 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131620:0:6924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000137e01df/0x1287b6a7b7c52719 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52720 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760731.131627:0:6924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789760731.131630:0:6924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760731.131633:0:6924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789760731.131635:0:6924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760731.131647:0:6924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131653:0:6924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.131666:0:6924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.131677:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486016:0@lo:101: 00000100:00100000:0.0:1789760731.131701:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.131711:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d9e58b2 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.132094:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486016 00000100:00100000:1.0:1789760731.132099:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486016 00000100:00100000:1.0:1789760731.132119:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760731.132124:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032edf806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486016:12345-0@lo:101: 00010000:00010000:1.0:1789760731.132138:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760731.132146:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f9b28cd/0x1287b6a7b7c5272e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52727 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.132159:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f9b28cd/0x1287b6a7b7c5272e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 11 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.132165:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f9b28cd/0x1287b6a7b7c5272e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 11 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.132171:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f9b28cd, rc 0) 00000100:00100000:1.0:1789760731.132207:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032edf806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066486016:12345-0@lo:101: Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.132212:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789760731.132237:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066485888 00000100:00100000:1.0:1789760731.132250:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066485888 00000100:00100000:1.0:1789760731.132275:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760731.132374:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486016:0@lo:101: 00010000:00010000:0.0:1789760731.132385:0:6924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.132391:0:6924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.132456:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486144:0@lo:501: 00000100:00100000:0.0:1789760731.132482:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.132502:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d9e58b2 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.132861:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ce72fdb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+11:3442:x1876700066485888:12345-0@lo:103: 00010000:00010000:1.0:1789760731.132871:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760731.132890:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000faa63906/0x1287b6a7b7c52712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1287b6a7b7c5270b expref: 11 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.132901:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760731.132932:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ce72fdb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+10:3442:x1876700066485888:12345-0@lo:103: Request processed in 651us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.132938:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760731.132958:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486144 00000100:00100000:1.0:1789760731.132961:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486144 00000100:00100000:1.0:1789760731.132975:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760731.132986:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008916aa12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486144:12345-0@lo:501: 00000100:00100000:1.0:1789760731.133069:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008916aa12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486144:12345-0@lo:501: Request processed in 83us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.133075:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789760731.133252:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c465195a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066485888:0@lo:103: 00000100:00100000:0.0:1789760731.133291:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486144:0@lo:501: 00000100:00100000:0.0:1789760731.133317:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486272:0@lo:503: 00000100:00100000:0.0:1789760731.133355:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.133382:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d9e58b2 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.133480:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486272 00000100:00100000:3.0:1789760731.133485:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486272 00000100:00100000:3.0:1789760731.133515:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789760731.133520:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d35c48bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486272:12345-0@lo:503: 00000100:00100000:3.0:1789760731.133598:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d35c48bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486272:12345-0@lo:503: Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.133605:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760731.133674:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486272:0@lo:503: 00000040:00080000:0.0:1789760731.133920:0:6924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760731.133982:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486400:0@lo:502: 00000100:00100000:0.0:1789760731.134026:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.134047:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d9e58b2 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.134098:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486400 00000100:00100000:3.0:1789760731.134102:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486400 00000100:00100000:3.0:1789760731.134126:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789760731.134131:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087425549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486400:12345-0@lo:502: 00000100:00100000:3.0:1789760731.134193:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087425549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486400:12345-0@lo:502: Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.134199:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760731.134272:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486400:0@lo:502: 00000040:00080000:0.0:1789760731.134553:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789760731.134576:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789760731.134590:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789760731.134601:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789760731.134616:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789760731.134626:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789760731.134643:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486528:0@lo:502: 00000100:00100000:0.0:1789760731.134672:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.134721:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d9e58b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.136197:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486528 00000100:00100000:2.0:1789760731.136209:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486528 00000100:00100000:3.0:1789760731.138214:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760731.138231:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002170083c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486528:12345-0@lo:502: 00000100:00100000:3.0:1789760731.138409:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002170083c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486528:12345-0@lo:502: Request processed in 183us (3735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.138417:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760731.138584:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486528:0@lo:502: 00000040:00080000:0.0:1789760731.138664:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789760731.138677:0:6924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789760731.140425:0:6946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789760731.140435:0:6946:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789760731.140447:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760731.140449:0:6946:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789760731.140456:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760731.140470:0:6946:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000002b8f22bd) 00000020:00000080:0.0:1789760731.140491:0:6946:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789760731.140497:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789760731.140595:0:6946:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1c9e908 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789760731.140603:0:6946:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789760731.140609:0:6946:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1287b6a7b7c5273c 00010000:00010000:0.0:1789760731.145471:0:6946:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789760731.145740:0:6946:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789760731.150800:0:6946:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789760731.151309:0:6946:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789760731.162390:0:6946:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789760731.162566:0:6946:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789760731.171307:0:6946:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789760731.172966:0:6946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789760731.172978:0:6946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760731.172990:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760731.172992:0:6946:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789760731.172996:0:6946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760731.173000:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760731.173001:0:6946:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760731.173004:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760731.173006:0:6946:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789760731.173027:0:6946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760731.173031:0:6946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760731.173032:0:6946:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760731.173035:0:6946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789760731.173180:0:6924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789760731.173215:0:6924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789760731.173231:0:6924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.173257:0:6924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000006cff13c4/0x1287b6a7b7c52727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760731.173265:0:6924:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c05703000 from 1 10000000:01000000:1.0:1789760731.173268:0:6924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760731.173305:0:6924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c52743 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.173312:0:6924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c52743 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.173322:0:6924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c52743 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.173344:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002674f1e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486656:0@lo:101: 00000100:00100000:1.0:1789760731.173418:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.173471:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000933caa9d going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.173606:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486656 00000100:00100000:0.0:1789760731.173614:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486656 00000100:00100000:0.0:1789760731.173663:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760731.173671:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cabacd80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+10:6924:x1876700066486656:12345-0@lo:101: 00010000:00010000:0.0:1789760731.173684:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760731.173696:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055aebdf1/0x1287b6a7b7c5274a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52743 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.173715:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055aebdf1/0x1287b6a7b7c5274a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 11 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.173724:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055aebdf1/0x1287b6a7b7c5274a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 11 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.173730:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055aebdf1, rc 0) 00000100:00100000:1.0:1789760731.173963:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002674f1e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486656:0@lo:101: 00010000:00010000:1.0:1789760731.173976:0:6924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c52743 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.173983:0:6924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000239b485b/0x1287b6a7b7c52743 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.174084:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002674f1e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486784:0@lo:501: 00000100:00100000:1.0:1789760731.174112:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.174139:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000933caa9d going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.174157:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486784 00000100:00100000:1.0:1789760731.174161:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486784 00000100:00100000:1.0:1789760731.174180:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760731.174185:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3f285b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066486784:12345-0@lo:501: 00000100:00100000:1.0:1789760731.174356:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3f285b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066486784:12345-0@lo:501: Request processed in 170us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.174364:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760731.174400:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002674f1e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486784:0@lo:501: 00000100:00100000:1.0:1789760731.174423:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002674f1e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486912:0@lo:503: 00000100:00100000:1.0:1789760731.174459:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.174472:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000933caa9d going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.174484:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066486912 00000100:00100000:1.0:1789760731.174487:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066486912 00000100:00100000:1.0:1789760731.174502:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760731.174507:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df1ed3c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066486912:12345-0@lo:503: 00000100:00100000:1.0:1789760731.174586:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df1ed3c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066486912:12345-0@lo:503: Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.174592:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760731.174632:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002674f1e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066486912:0@lo:503: 00000100:00100000:0.0:1789760731.174996:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cabacd80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066486656:12345-0@lo:101: Request processed in 128us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.175005:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:3.0:1789760731.176053:0:6924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760731.176143:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487040:0@lo:502: 00000100:00100000:3.0:1789760731.176199:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.176237:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f8a183ca going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.176337:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487040 00000100:00100000:1.0:1789760731.176343:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487040 00000100:00100000:1.0:1789760731.176384:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760731.176392:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ae65154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066487040:12345-0@lo:502: 00000100:00100000:1.0:1789760731.176496:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ae65154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066487040:12345-0@lo:502: Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.176503:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789760731.176608:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e73ef9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487040:0@lo:502: 00000040:00080000:0.0:1789760731.176895:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789760731.176929:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789760731.176952:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487168:0@lo:502: 00000100:00100000:0.0:1789760731.176989:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.177014:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054d51a18 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.177083:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487168 00000100:00100000:3.0:1789760731.177088:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487168 00000100:00100000:3.0:1789760731.177116:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789760731.177122:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1c88bcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066487168:12345-0@lo:502: 00000100:00100000:3.0:1789760731.177194:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1c88bcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066487168:12345-0@lo:502: Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.177200:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760731.177354:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f001e5e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487168:0@lo:502: 00000040:00080000:0.0:1789760731.177396:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789760731.177405:0:6924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789760731.178186:0:6949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760731.178196:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760731.178198:0:6949:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789760731.178205:0:6949:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09c05703000 00000020:00000080:0.0:1789760731.178207:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789760731.178297:0:6949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760731.178302:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760731.178303:0:6949:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789760731.178307:0:6949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789760731.178905:0:6924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789760731.178932:0:6924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760731.178950:0:6924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.178962:0:6924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760731.179005:0:6924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789760731.179008:0:6924:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa09c05703000 10000000:01000000:1.0:1789760731.179011:0:6924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa09c05703000 10000000:01000000:1.0:1789760731.179015:0:6924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760731.179020:0:6924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c05703000 from 1 10000000:01000000:1.0:1789760731.179023:0:6924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760731.179053:0:6924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.179070:0:6924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.179081:0:6924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.179100:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487296:0@lo:101: 00000100:00100000:1.0:1789760731.179153:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.181081:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3809c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.181153:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487296 00000100:00100000:3.0:1789760731.181161:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487296 00000100:00100000:3.0:1789760731.181252:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789760731.181264:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:6924:x1876700066487296:12345-0@lo:101: 00010000:00010000:3.0:1789760731.181279:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760731.181295:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52751 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.181320:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 12 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.181332:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 12 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.181341:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01681000, rc 0) 00000100:00100000:3.0:1789760731.181407:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487296:12345-0@lo:101: Request processed in 145us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.181414:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789760731.181485:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487296:0@lo:101: 00010000:00010000:1.0:1789760731.181500:0:6924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.181510:0:6924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.181606:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487424:0@lo:501: 00000100:00100000:1.0:1789760731.181639:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.181738:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3809c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.181925:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487424 00000100:00100000:0.0:1789760731.181929:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487424 00000100:00100000:0.0:1789760731.181955:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760731.181962:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487424:12345-0@lo:501: 00000100:00100000:0.0:1789760731.182064:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487424:12345-0@lo:501: Request processed in 101us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.182071:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789760731.182159:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487424:0@lo:501: 00000100:00100000:1.0:1789760731.182187:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487552:0@lo:503: 00000100:00100000:1.0:1789760731.182231:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.182259:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3809c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.182309:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487552 00000100:00100000:0.0:1789760731.182314:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487552 00000100:00100000:0.0:1789760731.182330:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760731.182336:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487552:12345-0@lo:503: 00000100:00100000:0.0:1789760731.182417:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487552:12345-0@lo:503: Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.182431:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789760731.182500:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487552:0@lo:503: 00000040:00080000:1.0:1789760731.182714:0:6924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760731.182844:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487680:0@lo:502: 00000100:00100000:1.0:1789760731.182888:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.182906:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3809c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.183104:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487680 00000100:00100000:0.0:1789760731.183110:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487680 00000100:00100000:0.0:1789760731.183131:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789760731.183138:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487680:12345-0@lo:502: 00000100:00100000:0.0:1789760731.183217:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487680:12345-0@lo:502: Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.183223:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789760731.183314:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487680:0@lo:502: 00000040:00080000:1.0:1789760731.183514:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789760731.183541:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789760731.183556:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789760731.183570:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789760731.183584:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789760731.183597:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789760731.183609:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789760731.183620:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789760731.183632:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789760731.183646:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789760731.183659:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789760731.183672:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789760731.183699:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789760731.183715:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789760731.183732:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789760731.183746:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789760731.183791:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789760731.183874:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789760731.183891:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789760731.183904:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789760731.183917:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789760731.183931:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789760731.183943:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789760731.183959:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789760731.183973:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789760731.183986:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789760731.183999:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789760731.184011:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789760731.184052:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487808:0@lo:502: 00000100:00100000:1.0:1789760731.184092:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.184122:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3809c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.184264:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487808 00000100:00100000:0.0:1789760731.184269:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487808 00000100:00100000:0.0:1789760731.184294:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789760731.184301:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487808:12345-0@lo:502: 00000100:00100000:0.0:1789760731.184379:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066487808:12345-0@lo:502: Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.184386:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789760731.184467:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066487808:0@lo:502: 00000040:00080000:1.0:1789760731.184506:0:6924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789760731.184514:0:6924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789760731.184970:0:6951:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789760731.184994:0:6951:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa09c3eb5cd28) 00000020:00000080:0.0:1789760731.185011:0:6951:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789760731.185083:0:6951:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09c05703000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789760731.185087:0:6951:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09c05703000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789760731.185089:0:6951:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09c05703000 3 00010000:00080000:0.0:1789760731.185128:0:6951:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09c3e88c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1789760731.190716:0:6951:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789760731.193555:0:6951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789760731.193604:0:6951:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789760731.193627:0:6951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1287b6a7b7c52766 00000100:00080000:0.0:1789760731.193637:0:6951:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760731.193644:0:6951:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa09c3e88c800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1789760731.193687:0:6951:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09c03415c00 x1876700066487936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760731.193724:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1876700066487936:0@lo:38: 00000100:00100000:0.0:1789760731.195009:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.195088:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066487936 00000100:00100000:0.0:1789760731.195096:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066487936 00000100:00100000:0.0:1789760731.195128:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760731.195135:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1876700066487936:12345-0@lo:38: 00010000:00080000:0.0:1789760731.195162:0:5948:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1789760731.195197:0:5948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1287b6a7b7c5276d 00000004:00100000:0.0:1789760731.195212:0:5948:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789760731.195253:0:5948:0:(import.c:65:import_set_state_nolock()) ffffa09c3ecab800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760731.195307:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3438:x1876700066487936:12345-0@lo:38: Request processed in 170us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.195314:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789760731.195352:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa09c03415c00 x1876700066487936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760731.195362:0:3438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789760731.195369:0:3438:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789760731.195375:0:3438:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789760731.195379:0:3438:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789760731.195381:0:3438:0:(import.c:65:import_set_state_nolock()) ffffa09c3e88c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789760731.195386:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1876700066487936:0@lo:38: 00000100:00080000:0.0:1789760731.195403:0:6951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789760731.196977:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760731.196993:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066488064:0@lo:400: 00000100:00100000:3.0:1789760731.197049:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.197254:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488064 00000100:00100000:3.0:1789760731.197261:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488064 00000100:00100000:3.0:1789760731.197307:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760731.197317:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066488064:12345-0@lo:400: 00000100:00100000:3.0:1789760731.197363:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066488064:12345-0@lo:400: Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.197370:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789760731.197403:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa09c04892680 x1876700066488064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760731.197423:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066488064:0@lo:400: 00000040:00080000:0.0:1789760731.197568:0:6951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789760731.197913:0:6924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789760731.197948:0:6924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760731.197968:0:6924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.197979:0:6924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789760731.198019:0:6924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789760731.198021:0:6924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760731.198023:0:6924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760731.198024:0:6924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760731.198025:0:6924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760731.198027:0:6924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760731.198028:0:6924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760731.198030:0:6924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760731.198031:0:6924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760731.198033:0:6924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760731.198034:0:6924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760731.198038:0:6924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789760731.198040:0:6924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789760731.198042:0:6924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760731.198043:0:6924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760731.198044:0:6924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760731.198045:0:6924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760731.198046:0:6924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760731.198047:0:6924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760731.198048:0:6924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760731.198049:0:6924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760731.198050:0:6924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760731.198051:0:6924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760731.198068:0:6924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789760731.198080:0:6924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066488192:0@lo:253: 00000100:00100000:0.0:1789760731.198118:0:6924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.198143:0:6924:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c17d87540 going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.198162:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488192 00000100:00100000:0.0:1789760731.198166:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488192 00000100:00100000:0.0:1789760731.198196:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760731.198202:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066488192:12345-0@lo:253: 20000000:01000000:0.0:1789760731.198221:0:5941:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789760731.198233:0:5941:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789760731.211681:0:5941:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789760731.211721:0:5941:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789760731.212070:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6924:x1876700066488192:12345-0@lo:253: Request processed in 13863us (13946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.212081:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760731.212219:0:6924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:6924:1876700066488192:0@lo:253: 10000000:01000000:1.0:1789760731.212234:0:6924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789760731.212238:0:6924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760731.212248:0:6924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789760731.212250:0:6924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760731.212251:0:6924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760731.212253:0:6924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760731.212254:0:6924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760731.212256:0:6924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760731.212257:0:6924:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760731.212258:0:6924:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760731.212260:0:6924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760731.212261:0:6924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789760731.212274:0:6924:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789760731.212909:0:5962:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789760731.212915:0:5962:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789760731.212934:0:5962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.212951:0:5962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 11 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.212960:0:5962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.212994:0:5962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 11 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.213008:0:5962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 11 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.213022:0:5962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5962:1876700066488320:0@lo:104: 00000100:00100000:0.0:1789760731.213082:0:5962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.213130:0:5962:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c17d87c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.213204:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488320 00000100:00100000:2.0:1789760731.213212:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488320 00000100:00100000:2.0:1789760731.213273:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760731.213282:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5962:x1876700066488320:12345-0@lo:104: 00010000:00010000:2.0:1789760731.213295:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.216483:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760731.216500:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5962:x1876700066488320:12345-0@lo:104: Request processed in 3216us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.216512:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789760731.216577:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760731.216586:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.216596:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f2200 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760731.216601:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.216630:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760731.216638:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760731.216643:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760731.216691:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.216698:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760731.216717:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.216724:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f2200/0x1287b6a7b7c526da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c526e1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.216742:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760731.216744:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760731.216745:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760731.216759:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066488448:0@lo:103: 00000100:00100000:0.0:1789760731.216839:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.216896:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488448 00000100:00100000:0.0:1789760731.216904:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488448 00010000:00010000:0.0:1789760731.216930:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 12 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760731.216957:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760731.216965:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c09551450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+12:3440:x1876700066488448:12345-0@lo:103: 00010000:00010000:0.0:1789760731.216983:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760731.216990:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 12 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217000:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 12 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217016:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217025:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789760731.217039:0:5934:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004124392s 00010000:00010000:0.0:1789760731.217043:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217051:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217057:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217063:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217069:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c35325a00 already unused, calling callback (ffffffffc0c66350) 00010000:00010000:0.0:1789760731.217073:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217079:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217095:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760731.217104:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760731.217136:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c09551450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+12:3440:x1876700066488448:12345-0@lo:103: Request processed in 172us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.217143:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760731.217200:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066488448:0@lo:103: 00010000:00010000:3.0:1789760731.217333:0:5962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c526e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c526da expref: 11 pid: 5940 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.217345:0:5962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5962:1876700066488320:0@lo:104: 00010000:00010000:3.0:1789760731.217358:0:5962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.217366:0:5962:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.217372:0:5962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.217378:0:5962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52774 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789760731.218670:0:6924:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789760731.219400:0:6924:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789760731.219597:0:6924:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789760731.219753:0:6924:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789760731.220184:0:6924:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789760731.220358:0:6924:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789760731.221641:0:6924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789760731.229116:0:6924:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789760731.229124:0:6924:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789760731.229161:0:6924:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789760731.229206:0:6924:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789760731.229225:0:6924:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789760731.229252:0:6924:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789760731.230120:0:6924:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760731.230293:0:6924:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789760731.401886:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760731.415177:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760731.415184:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c1126a000 from 21 10000000:01000000:1.0:1789760731.415198:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760731.415247:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.415258:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.415268:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.415303:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066488576:0@lo:101: 00000100:00100000:1.0:1789760731.415374:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.415425:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c352e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.415544:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488576 00000100:00100000:2.0:1789760731.415551:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488576 00000100:00100000:2.0:1789760731.415617:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760731.415632:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+11:5944:x1876700066488576:12345-0@lo:101: 00010000:00010000:2.0:1789760731.415646:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760731.415661:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5277b expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.415683:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 12 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.415705:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 12 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.415714:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01546000, rc 0) 00000100:00100000:2.0:1789760731.415779:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066488576:12345-0@lo:101: Request processed in 132us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.415799:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789760731.415902:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066488576:0@lo:101: 00010000:00010000:1.0:1789760731.415915:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.415924:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.415979:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066488704:0@lo:501: 00000100:00100000:1.0:1789760731.416004:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.416032:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c352e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789760731.416120:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488704 00000100:00100000:0.0:1789760731.416126:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488704 00000100:00100000:0.0:1789760731.416159:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789760731.416167:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066488704:12345-0@lo:501: 00000100:00100000:0.0:1789760731.416298:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066488704:12345-0@lo:501: Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.416305:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789760731.416414:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066488704:0@lo:501: 00000100:00100000:1.0:1789760731.416439:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066488832:0@lo:503: 00000100:00100000:1.0:1789760731.416476:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.416500:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c352e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.416637:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488832 00000100:00100000:2.0:1789760731.416641:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488832 00000100:00100000:2.0:1789760731.416675:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760731.416682:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066488832:12345-0@lo:503: 00000100:00100000:2.0:1789760731.416804:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066488832:12345-0@lo:503: Request processed in 121us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.416811:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789760731.416886:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066488832:0@lo:503: 00000100:00100000:1.0:1789760731.417918:0:6968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6968:1876700066488960:0@lo:502: 00000100:00100000:1.0:1789760731.417976:0:6968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.418013:0:6968:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08beec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.418064:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066488960 00000100:00100000:2.0:1789760731.418071:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066488960 00000100:00100000:2.0:1789760731.418111:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760731.418120:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6968:x1876700066488960:12345-0@lo:502: 00000100:00100000:2.0:1789760731.418397:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:6968:x1876700066488960:12345-0@lo:502: Request processed in 278us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.418405:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789760731.418972:0:6968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6968:1876700066488960:0@lo:502: 00000100:00100000:1.0:1789760731.419027:0:6968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6968:1876700066489088:0@lo:502: 00000100:00100000:1.0:1789760731.419076:0:6968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.419512:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489088 00000100:00100000:2.0:1789760731.419519:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489088 00000100:00100000:2.0:1789760731.419557:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760731.419566:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:6968:x1876700066489088:12345-0@lo:502: 00000100:00100000:2.0:1789760731.419656:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:6968:x1876700066489088:12345-0@lo:502: Request processed in 90us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.419669:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789760731.420063:0:6968:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08beec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.420087:0:6968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6968:1876700066489088:0@lo:502: 00000040:00080000:1.0:1789760731.420172:0:6968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789760731.420905:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789760731.420925:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760731.420936:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.420947:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760731.420957:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789760731.420960:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09c1126a000 from 4 10000000:01000000:2.0:1789760731.420963:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760731.420994:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.421003:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.421013:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.421031:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489216:0@lo:101: 00000100:00100000:2.0:1789760731.421219:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.421326:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.421344:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489216 00000100:00100000:2.0:1789760731.421349:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489216 00000100:00100000:2.0:1789760731.421384:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760731.421393:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066489216:12345-0@lo:101: 00010000:00010000:2.0:1789760731.421403:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760731.421425:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52789 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.421447:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 13 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.421456:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 13 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.421464:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01547200, rc 0) 00000100:00100000:2.0:1789760731.421504:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066489216:12345-0@lo:101: Request processed in 111us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.421511:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760731.421564:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489216:0@lo:101: 00010000:00010000:2.0:1789760731.421578:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.421587:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.421637:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489344:0@lo:256: 00000100:00100000:2.0:1789760731.421674:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.421694:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.421709:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489344 00000100:00100000:2.0:1789760731.421712:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489344 00000100:00100000:2.0:1789760731.421742:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760731.421749:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066489344:12345-0@lo:256: 20000000:01000000:2.0:1789760731.421778:0:5940:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789760731.421793:0:5940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789760731.422330:0:5940:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789760731.422408:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066489344:12345-0@lo:256: Request processed in 659us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.422416:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760731.422454:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489344:0@lo:256: 10000000:01000000:2.0:1789760731.422492:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789760731.422499:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.422506:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760731.422514:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789760731.422516:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789760731.422519:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760731.422539:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.422545:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.422552:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.422564:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489472:0@lo:101: 00000100:00100000:2.0:1789760731.422589:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.422603:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.422615:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489472 00000100:00100000:2.0:1789760731.422618:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489472 00000100:00100000:2.0:1789760731.422642:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789760731.422656:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066489472:12345-0@lo:101: 00010000:00010000:2.0:1789760731.422665:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760731.422675:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52797 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.422691:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 14 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.422700:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 14 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.422708:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01547a00, rc 0) 00000100:00100000:2.0:1789760731.422737:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066489472:12345-0@lo:101: Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.422743:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789760731.422789:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489472:0@lo:101: 00010000:00010000:2.0:1789760731.424911:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760731.424929:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760731.425019:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489600:0@lo:501: 00000100:00100000:2.0:1789760731.425349:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.425392:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.425420:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489600 00000100:00100000:2.0:1789760731.425426:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489600 00000100:00100000:2.0:1789760731.425465:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760731.425475:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066489600:12345-0@lo:501: 00000100:00100000:2.0:1789760731.425612:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066489600:12345-0@lo:501: Request processed in 138us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.425620:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760731.425670:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489600:0@lo:501: 00000100:00100000:2.0:1789760731.425704:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489728:0@lo:503: 00000100:00100000:2.0:1789760731.425741:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.425754:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.425783:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489728 00000100:00100000:2.0:1789760731.425787:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489728 00000100:00100000:2.0:1789760731.427373:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760731.427389:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066489728:12345-0@lo:503: 00000100:00100000:2.0:1789760731.427521:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066489728:12345-0@lo:503: Request processed in 137us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.427528:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760731.427587:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066489728:0@lo:503: 00000100:00100000:3.0:1789760731.436509:0:6970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6970:1876700066489856:0@lo:502: 00000100:00100000:3.0:1789760731.436589:0:6970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.436627:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489856 00000100:00100000:3.0:1789760731.436634:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489856 00000100:00100000:3.0:1789760731.436682:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760731.436691:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:6970:x1876700066489856:12345-0@lo:502: 00000100:00100000:3.0:1789760731.436840:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:6970:x1876700066489856:12345-0@lo:502: Request processed in 149us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.436848:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760731.436905:0:6970:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c02e59cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.436931:0:6970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6970:1876700066489856:0@lo:502: 00000020:01000000:3.0:1789760731.436960:0:6970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760731.436969:0:6970:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789760731.436977:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760731.436979:0:6970:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789760731.436985:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760731.436988:0:6970:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:3.0:1789760731.437010:0:6970:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789760731.437013:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760731.437029:0:6970:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa09c3525b370) 00000020:00000080:3.0:1789760731.437049:0:6970:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789760731.437056:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760731.437143:0:6970:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789760731.437149:0:6970:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789760731.437157:0:6970:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c527ac 00010000:00080000:3.0:1789760731.437201:0:6970:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09c08943000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1789760731.437449:0:6970:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789760731.444633:0:6970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789760731.444656:0:6970:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789760731.445413:0:6970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760731.445597:0:6970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760731.445689:0:6970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789760731.445832:0:6970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789760731.447505:0:6971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789760731.447512:0:6971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789760731.448571:0:6970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789760731.448585:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789760731.448624:0:6970:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789760731.448646:0:6970:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1287b6a7b7c527b3 00000100:00080000:1.0:1789760731.448656:0:6970:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760731.448661:0:6970:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa09c08943000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1789760731.448697:0:6970:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09c17d35c00 x1876700066489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760731.448757:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1876700066489984:0@lo:8: 00000100:00100000:2.0:1789760731.448866:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.449039:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066489984 00000100:00100000:3.0:1789760731.449047:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066489984 00000100:00100000:3.0:1789760731.449078:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760731.449085:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3438:x1876700066489984:12345-0@lo:8: 00010000:00080000:3.0:1789760731.449108:0:6931:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1789760731.449129:0:6931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1287b6a7b7c527ba 00002000:00100000:3.0:1789760731.449156:0:6931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa09c08941800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789760731.449161:0:6931:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789760731.449165:0:6931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789760731.449224:0:6931:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789760731.449474:0:6931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789760731.449497:0:6931:0:(import.c:65:import_set_state_nolock()) ffffa09c08941000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789760731.449585:0:6970:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789760731.449657:0:6970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760731.449662:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760731.449664:0:6970:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789760731.449668:0:6970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760731.449672:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760731.449673:0:6970:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760731.449676:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760731.449678:0:6970:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789760731.449704:0:6970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6970:1876700066490112:0@lo:502: 00000100:00100000:1.0:1789760731.449752:0:6970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.449787:0:6970:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c17fe70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.450019:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3438:x1876700066489984:12345-0@lo:8: Request processed in 931us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.450027:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760731.450094:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c17d35c00 x1876700066489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760731.450104:0:3438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760731.450112:0:3438:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789760731.450119:0:3438:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789760731.450123:0:3438:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789760731.450125:0:3438:0:(import.c:65:import_set_state_nolock()) ffffa09c08943000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789760731.450183:0:3438:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789760731.450196:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1876700066489984:0@lo:8: 00000100:00100000:2.0:1789760731.450221:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490112 00000100:00100000:2.0:1789760731.450226:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490112 00000100:00100000:2.0:1789760731.450268:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760731.450275:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:6970:x1876700066490112:12345-0@lo:502: 00000100:00100000:2.0:1789760731.450375:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:6970:x1876700066490112:12345-0@lo:502: Request processed in 100us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.450383:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760731.450428:0:6970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6970:1876700066490112:0@lo:502: 00000020:01000000:2.0:1789760731.450452:0:6970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760731.450457:0:6970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760731.450459:0:6970:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789760731.450462:0:6970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:1.0:1789760731.450601:0:6971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789760731.450647:0:6971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185489884569ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789760731.450654:0:6971:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1789760731.450887:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789760731.450907:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789760731.450916:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.450927:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760731.450937:0:5944:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760731.450939:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c1126a000 from 1 10000000:01000000:1.0:1789760731.450942:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760731.450967:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.450975:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760731.450985:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760731.451000:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d34e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066490240:0@lo:101: 00000100:00100000:1.0:1789760731.451035:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.451059:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c17fe76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.451661:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490240 00000100:00100000:3.0:1789760731.451668:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490240 00000100:00100000:3.0:1789760731.451742:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789760731.451751:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066490240:12345-0@lo:101: 00010000:00010000:3.0:1789760731.451778:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760731.451792:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c527c1 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.451824:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 15 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.451836:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 15 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.451856:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01681600, rc 0) 00000100:00100000:3.0:1789760731.451897:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066490240:12345-0@lo:101: Request processed in 147us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.451903:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:2.0:1789760731.452708:0:5926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789760731.453087:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d34e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066490240:0@lo:101: 00010000:00010000:3.0:1789760731.453107:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.453117:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.453183:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066490368:0@lo:501: 00000100:00100000:3.0:1789760731.453223:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.453292:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08d4f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.453332:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490368 00000100:00100000:2.0:1789760731.453337:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490368 00000100:00100000:2.0:1789760731.453405:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789760731.453414:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066490368:12345-0@lo:501: 00000100:00100000:2.0:1789760731.453522:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066490368:12345-0@lo:501: Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.453530:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760731.453598:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066490368:0@lo:501: 00000100:00100000:3.0:1789760731.453640:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066490496:0@lo:503: 00000100:00100000:3.0:1789760731.453679:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.453788:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08d4f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.453919:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490496 00000100:00100000:1.0:1789760731.453924:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490496 00000100:00100000:1.0:1789760731.453953:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789760731.453959:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066490496:12345-0@lo:503: 00000100:00100000:1.0:1789760731.454039:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066490496:12345-0@lo:503: Request processed in 79us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.454045:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789760731.454150:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066490496:0@lo:503: 00000100:00100000:2.0:1789760731.454480:0:6973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6973:1876700066490624:0@lo:502: 00000100:00100000:2.0:1789760731.454517:0:6973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.454576:0:6973:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ecebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760731.454606:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490624 00000100:00100000:1.0:1789760731.454611:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490624 00000100:00100000:1.0:1789760731.454667:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760731.454673:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:6973:x1876700066490624:12345-0@lo:502: 00000100:00100000:1.0:1789760731.454755:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:6973:x1876700066490624:12345-0@lo:502: Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.454783:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789760731.454900:0:6973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6973:1876700066490624:0@lo:502: 00000020:01000000:3.0:1789760731.454922:0:6973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760731.454931:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760731.454934:0:6973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789760731.454940:0:6973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09c1126a000 00000020:00000080:3.0:1789760731.454947:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789760731.454970:0:6973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6973:1876700066490752:0@lo:502: 00000100:00100000:3.0:1789760731.455000:0:6973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.455110:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490752 00000100:00100000:1.0:1789760731.455114:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490752 00000100:00100000:1.0:1789760731.455131:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789760731.455136:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:6973:x1876700066490752:12345-0@lo:502: 00000100:00100000:1.0:1789760731.455193:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:6973:x1876700066490752:12345-0@lo:502: Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.455199:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760731.455289:0:6973:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c02f7d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.455302:0:6973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:6973:1876700066490752:0@lo:502: 00000020:01000000:3.0:1789760731.455320:0:6973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1789760731.456423:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066490880:0@lo:13: 00000100:00100000:1.0:1789760731.456472:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789760731.456529:0:6972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789760731.456551:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491008:0@lo:7: 00000100:00100000:2.0:1789760731.456577:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.456599:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.456621:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491008 00000100:00100000:2.0:1789760731.456626:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491008 00000100:00100000:2.0:1789760731.456677:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760731.456683:0:6932:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789760731.456688:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6972:x1876700066491008:12345-0@lo:7: 00000100:00100000:0.0:1789760731.456695:0:6932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789760731.457913:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066490880 00000100:00100000:3.0:1789760731.457920:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066490880 00000100:00100000:3.0:1789760731.457955:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760731.457964:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3441:x1876700066490880:12345-0@lo:13: 00002000:00000024:3.0:1789760731.457981:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1789760731.460947:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3441:x1876700066490880:12345-0@lo:13: Request processed in 2978us (4468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.460960:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789760731.460994:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789760731.461009:0:6973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760731.461012:0:6973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789760731.461018:0:6973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789760731.461075:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789760731.461110:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789760731.461120:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461131:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760731.461140:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789760731.461142:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa09c11ff0000 from 1 10000000:01000000:3.0:1789760731.461145:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760731.461186:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461194:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461205:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.461225:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066491136:0@lo:101: 00000100:00100000:3.0:1789760731.461289:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.461321:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08d4f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.461338:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491136 00000100:00100000:3.0:1789760731.461344:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491136 00000100:00100000:3.0:1789760731.461377:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760731.461386:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066491136:12345-0@lo:101: 00010000:00010000:3.0:1789760731.461397:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760731.461409:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c527cf expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461432:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461441:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461450:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01681a00, rc 0) 00000100:00100000:3.0:1789760731.461483:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066491136:12345-0@lo:101: Request processed in 98us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.461488:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760731.461535:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066491136:0@lo:101: 00010000:00010000:3.0:1789760731.461549:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.461557:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760731.461609:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066491264:0@lo:501: 00000100:00100000:3.0:1789760731.461632:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.461643:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08d4f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.461654:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491264 00000100:00100000:3.0:1789760731.461657:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491264 00000100:00100000:3.0:1789760731.461675:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789760731.461679:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066491264:12345-0@lo:501: 00000100:00100000:3.0:1789760731.461736:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066491264:12345-0@lo:501: Request processed in 55us (102us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760731.461742:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789760731.461790:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066491264:0@lo:501: 00002000:00080000:2.0:1789760731.461892:0:6933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789760731.461899:0:6933:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789760731.461944:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6972:x1876700066491008:12345-0@lo:7: Request processed in 5259us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.461951:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789760731.461982:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423480 x1876700066491008/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760731.461994:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491008:0@lo:7: 00000004:00080000:2.0:1789760731.462003:0:6972:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789760731.462022:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491392:0@lo:5: 00000100:00100000:2.0:1789760731.462047:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.462062:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.462073:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491392 00000100:00100000:2.0:1789760731.462077:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491392 00000100:00100000:2.0:1789760731.462097:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760731.462104:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6972:x1876700066491392:12345-0@lo:5: 00002000:00080000:2.0:1789760731.462122:0:6933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789760731.462126:0:6933:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 10000000:01000000:3.0:1789760731.462398:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760731.462406:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760731.462414:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789760731.462580:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03422a00 x1876700066490880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760731.462599:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066490880:0@lo:13: 00000001:00080000:2.0:1789760731.464299:0:6926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789760731.464313:0:6926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789760731.464419:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6972:x1876700066491392:12345-0@lo:5: Request processed in 2312us (2367us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789760731.464428:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789760731.464479:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423480 x1876700066491392/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760731.464490:0:6972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789760731.464495:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491392:0@lo:5: 00000004:00080000:2.0:1789760731.464506:0:6972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789760731.464545:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491520:0@lo:700: 00000100:00100000:2.0:1789760731.464577:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.464600:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760731.464622:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491520 00000100:00100000:2.0:1789760731.464628:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491520 00000100:00100000:2.0:1789760731.464667:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760731.464675:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6972:x1876700066491520:12345-0@lo:700: 00000100:00100000:2.0:1789760731.464707:0:6939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6939:1876700066491648:0@lo:700: 00000100:00100000:2.0:1789760731.464745:0:6939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.464801:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491648 00000100:00100000:0.0:1789760731.464807:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491648 00000100:00100000:0.0:1789760731.464843:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760731.464849:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6939:x1876700066491648:12345-0@lo:700: 00000100:00100000:2.0:1789760731.464866:0:6939:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb780 going to sleep for 11 seconds 00000100:00080000:3.0:1789760731.465035:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:3.0:1789760731.469965:0:5953:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789760731.478645:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6939:x1876700066491648:12345-0@lo:700: Request processed in 13788us (13892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.478658:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789760731.479319:0:6939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423800 x1876700066491648/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760747 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760731.479351:0:6939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6939:1876700066491648:0@lo:700: 40000000:02000000:3.0:1789760731.479364:0:6939:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1789760731.501399:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6972:x1876700066491520:12345-0@lo:700: Request processed in 36716us (36812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.501419:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760731.501512:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423480 x1876700066491520/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760731.501528:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491520:0@lo:700: 00000004:02000040:2.0:1789760731.508161:0:6972:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789760731.514636:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491776:0@lo:5: 00000100:00100000:2.0:1789760731.514715:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760731.514781:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3eceb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760731.514912:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491776 00000100:00100000:3.0:1789760731.514920:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491776 00000100:00100000:3.0:1789760731.514973:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760731.514982:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6972:x1876700066491776:12345-0@lo:5: 00002000:00080000:2.0:1789760731.524086:0:6931:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789760731.524107:0:6931:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789760731.526326:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6972:x1876700066491776:12345-0@lo:5: Request processed in 11338us (11605us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789760731.526344:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789760731.526378:0:6972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423480 x1876700066491776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760747 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760731.526395:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6972:1876700066491776:0@lo:5: 00000004:00080000:3.0:1789760731.526408:0:6972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000020:00000004:1.0:1789760732.041212:0:7012:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789760732.042340:0:7012:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789760732.425491:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760733.449090:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760734.472920:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760735.498312:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789760736.367142:0:7301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789760736.520944:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760736.906072:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760736.906097:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066491904:0@lo:13: 00000100:00100000:3.0:1789760736.906158:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760736.906237:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066491904 00000100:00100000:3.0:1789760736.906243:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066491904 00000100:00100000:3.0:1789760736.906293:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760736.906303:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1876700066491904:12345-0@lo:13: 00002000:00000024:3.0:1789760736.906332:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760736.906374:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1876700066491904:12345-0@lo:13: Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760736.906381:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789760736.906401:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760736.906438:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c04892680 x1876700066491904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760736.906456:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066491904:0@lo:13: 00000100:00100000:2.0:1789760736.906676:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760736.906685:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1876700066492288:0@lo:400: 00000100:00100000:2.0:1789760736.906718:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760736.906794:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492288 00000100:00100000:2.0:1789760736.906799:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492288 00000100:00100000:2.0:1789760736.906833:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760736.906840:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1876700066492288:12345-0@lo:400: 00000100:00100000:2.0:1789760736.906875:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1876700066492288:12345-0@lo:400: Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760736.906881:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789760736.906899:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789760736.906915:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423800 x1876700066492288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760736.906926:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1876700066492288:0@lo:400: 00000100:00100000:1.0:1789760736.906993:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066492032:0@lo:400: 00000100:00100000:1.0:1789760736.907027:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.907053:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760736.907059:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066492160:0@lo:400: 00000100:00100000:1.0:1789760736.907081:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.907107:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492160 00000100:00100000:1.0:1789760736.907111:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492160 00000100:00100000:1.0:1789760736.907132:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760736.907138:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066492160:12345-0@lo:400: 00000100:00100000:1.0:1789760736.907171:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066492160:12345-0@lo:400: Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760736.907177:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789760736.907210:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03420a80 x1876700066492160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760736.907228:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066492160:0@lo:400: 00000100:00100000:2.0:1789760736.907329:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492032 00000100:00100000:2.0:1789760736.907334:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492032 00000100:00100000:2.0:1789760736.907371:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789760736.907378:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:3439:x1876700066492032:12345-0@lo:400: 00000100:00100000:2.0:1789760736.907414:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:3439:x1876700066492032:12345-0@lo:400: Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760736.907421:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789760736.907455:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066492032:0@lo:400: 00000001:00080000:3.0:1789760736.915337:0:6926:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000020:00000004:3.0:1789760737.160484:0:7353:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760737.160678:0:7353:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789760737.551425:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760738.568869:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760739.592940:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789760739.650732:0:7455:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789760739.651125:0:7455:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1789760740.426169:0:7503:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760740.426193:0:7503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789760740.616974:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760741.641482:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760742.025556:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1876700066492672:0@lo:400: 00000100:00100000:0.0:1789760742.025636:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760742.025691:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760742.025698:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066492544:0@lo:400: 00000100:00100000:0.0:1789760742.025721:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760742.025752:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492672 00000100:00100000:0.0:1789760742.025779:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492672 00000100:00100000:0.0:1789760742.025824:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492544 00000100:00100000:0.0:1789760742.025828:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492544 00000100:00100000:0.0:1789760742.025844:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760742.025852:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1876700066492672:12345-0@lo:400: 00000100:00100000:3.0:1789760742.025895:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066492800:0@lo:400: 00000100:00100000:0.0:1789760742.025906:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1876700066492672:12345-0@lo:400: Request processed in 55us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760742.025913:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760742.025925:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760742.025930:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760742.025935:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066492544:12345-0@lo:400: 00000100:00100000:3.0:1789760742.025949:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760742.025955:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066492416:0@lo:400: 00000100:00100000:0.0:1789760742.025960:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066492544:12345-0@lo:400: Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760742.025966:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760742.025988:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789760742.026007:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03414000 x1876700066492544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760742.026022:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066492544:0@lo:400: 00010000:00080000:0.0:1789760742.026035:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03415500 x1876700066492672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760742.026043:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1876700066492672:0@lo:400: 00000100:00100000:3.0:1789760742.026056:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492416 00000100:00100000:3.0:1789760742.026060:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492416 00000100:00100000:3.0:1789760742.026087:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760742.026093:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:3441:x1876700066492416:12345-0@lo:400: 00000100:00100000:3.0:1789760742.026123:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:3441:x1876700066492416:12345-0@lo:400: Request processed in 30us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760742.026129:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760742.026169:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066492416:0@lo:400: 00000100:00100000:2.0:1789760742.026182:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066492928:0@lo:13: 00000100:00100000:2.0:1789760742.026748:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760742.026811:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760742.026826:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492800 00000100:00100000:2.0:1789760742.026831:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492800 00000100:00100000:2.0:1789760742.026865:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760742.026872:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066492800:12345-0@lo:400: 00000100:00100000:2.0:1789760742.026910:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066492800:12345-0@lo:400: Request processed in 38us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760742.026916:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760742.026944:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03416300 x1876700066492800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760742.026953:0:3441:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789760742.026963:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066492800:0@lo:400: 00000100:00080000:0.0:1789760742.027432:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760742.027896:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066492928 00000100:00100000:3.0:1789760742.027902:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066492928 00000100:00100000:3.0:1789760742.027934:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760742.027942:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066492928:12345-0@lo:13: 00002000:00000024:3.0:1789760742.027974:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760742.028017:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066492928:12345-0@lo:13: Request processed in 75us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760742.028024:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789760742.028341:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c04891880 x1876700066492928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760742.028360:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066492928:0@lo:13: 00010000:00010000:0.0:1789760742.665037:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760743.690098:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760744.716039:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760745.738841:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760746.761727:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760747.145314:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066493184:0@lo:400: 00000100:00100000:0.0:1789760747.145405:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.145469:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760747.145474:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066493056:0@lo:400: 00000100:00100000:0.0:1789760747.145502:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.145532:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066493312:0@lo:400: 00000100:00100000:0.0:1789760747.145553:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.145570:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760747.145574:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066493440:0@lo:400: 00000100:00100000:0.0:1789760747.145601:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.145635:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493184 00000100:00100000:0.0:1789760747.145644:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493184 00000100:00100000:0.0:1789760747.145692:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493312 00000100:00100000:0.0:1789760747.145694:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493312 00000100:00100000:0.0:1789760747.145732:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760747.145740:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066493184:12345-0@lo:400: 00000100:00100000:0.0:1789760747.145814:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066493184:12345-0@lo:400: Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.145822:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760747.145838:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760747.145844:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066493312:12345-0@lo:400: 00000100:00100000:0.0:1789760747.145869:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066493312:12345-0@lo:400: Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.145874:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760747.145891:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493056 00000100:00100000:0.0:1789760747.145903:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493056 00000100:00100000:0.0:1789760747.145928:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789760747.145933:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:3440:x1876700066493056:12345-0@lo:400: 00000100:00100000:0.0:1789760747.145960:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:3440:x1876700066493056:12345-0@lo:400: Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.145965:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789760747.145996:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493440 00000100:00100000:0.0:1789760747.145999:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493440 00000100:00100000:0.0:1789760747.146025:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760747.146031:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066493440:12345-0@lo:400: 00000100:00100000:0.0:1789760747.146058:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066493440:12345-0@lo:400: Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.146063:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789760747.146082:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760747.146086:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760747.146133:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03417b80 x1876700066493440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760747.146151:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066493440:0@lo:400: 00010000:00080000:0.0:1789760747.146163:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03414380 x1876700066493312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760747.146171:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066493312:0@lo:400: 00000100:00100000:0.0:1789760747.146200:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066493056:0@lo:400: 00010000:00080000:0.0:1789760747.146209:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03414000 x1876700066493184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760747.146217:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066493184:0@lo:400: 00000100:00100000:1.0:1789760747.146730:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066493568:0@lo:13: 00000100:00100000:1.0:1789760747.146802:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.147197:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493568 00000100:00100000:1.0:1789760747.147204:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493568 00000100:00100000:1.0:1789760747.147249:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760747.147258:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066493568:12345-0@lo:13: 00002000:00000024:1.0:1789760747.147290:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760747.147399:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066493568:12345-0@lo:13: Request processed in 142us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760747.147418:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789760747.147702:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03414000 x1876700066493568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760747.147720:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066493568:0@lo:13: 00010000:00010000:3.0:1789760747.788243:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789760747.879176:0:8001:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789760747.879181:0:8001:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789760747.879182:0:8001:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789760747.879341:0:8001:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa09c08945800 00000020:01000004:3.0:1789760747.879363:0:8001:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789760747.879380:0:8001:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789760747.879398:0:8001:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa09c352599b8) 00000020:00000080:3.0:1789760747.879420:0:8001:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789760747.915861:0:8001:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789760747.915950:0:8001:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789760747.956126:0:8001:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789760747.956380:0:8001:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789760747.956395:0:8001:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789760747.956410:0:8001:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1287b6a7b7c527e4 00000020:01000004:1.0:1789760747.956418:0:8001:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789760747.956447:0:8001:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789760747.956452:0:8001:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789760747.956460:0:8001:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789760747.956498:0:8001:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789760747.956504:0:8001:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789760747.975000:0:8001:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789760747.975052:0:8001:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789760747.975057:0:8001:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789760747.975059:0:8001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760747.975060:0:8001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760747.975062:0:8001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760747.975064:0:8001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760747.975065:0:8001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760747.975067:0:8001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760747.975069:0:8001:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760747.975070:0:8001:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760747.975072:0:8001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760747.975074:0:8001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760747.975079:0:8001:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789760747.975081:0:8001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760747.975083:0:8001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760747.975084:0:8001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760747.975085:0:8001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760747.975086:0:8001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760747.975087:0:8001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760747.975088:0:8001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760747.975089:0:8001:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760747.975091:0:8001:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760747.975092:0:8001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760747.975100:0:8001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760747.975160:0:8001:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789760747.975186:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066493696:0@lo:253: 00000100:00100000:1.0:1789760747.975279:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.975400:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3aec99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760747.975458:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493696 00000100:00100000:3.0:1789760747.975470:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493696 00000100:00100000:3.0:1789760747.975588:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789760747.975601:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:8001:x1876700066493696:12345-0@lo:253: 20000000:01000000:3.0:1789760747.975651:0:5941:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789760747.975656:0:5941:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789760747.975662:0:5941:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789760747.975666:0:5941:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789760747.976225:0:5941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760747.976605:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789760747.976626:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789760747.976644:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789760747.976650:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789760747.976663:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789760747.977026:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789760747.977157:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789760747.977177:0:5941:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1789760747.977179:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1789760747.977196:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789760747.977203:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760747.977218:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789760747.977225:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1789760747.977239:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789760747.977247:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760747.977261:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789760747.977277:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789760747.977659:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789760747.977686:0:5941:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1789760747.977688:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1789760747.977705:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789760747.977711:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789760747.977724:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789760747.977729:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1789760747.977743:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789760747.977749:0:5941:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760747.978435:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789760747.978466:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789760747.978486:0:5941:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789760747.978489:0:5941:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789760747.978494:0:5941:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789760747.978550:0:5941:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789760747.978553:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760747.979285:0:8007:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760747.979330:0:8007:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760747.979347:0:8007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789760747.979600:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789760747.979623:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789760747.979638:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789760747.979647:0:5941:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789760747.979656:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760747.980496:0:8008:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760747.980533:0:8008:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760747.980549:0:8008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789760747.980740:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789760747.981003:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789760747.981025:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789760747.981039:0:5941:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789760747.981041:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760747.981379:0:8009:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760747.981407:0:8009:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760747.981424:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789760747.981576:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789760747.981597:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789760747.981613:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789760747.981625:0:5941:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789760747.981627:0:5941:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789760747.982338:0:8010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789760747.982513:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789760747.982537:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789760747.982555:0:5941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1789760747.982574:0:5941:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789760747.982603:0:5941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982627:0:5941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982635:0:5941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 16 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982642:0:5941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 16 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982649:0:5941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 16 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982657:0:5941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982687:0:5941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.982740:0:5941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.983277:0:5941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 16 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.983299:0:5941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066493824:0@lo:104: 00000100:00100000:3.0:1789760747.983396:0:5941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760747.983510:0:5941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 16 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.983520:0:5941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 16 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.983529:0:5941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066493952:0@lo:104: 00010000:00010000:3.0:1789760747.983556:0:5941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 16 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.983565:0:5941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 16 pid: 5940 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.983573:0:5941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066494080:0@lo:104: 00010000:00010000:3.0:1789760747.983598:0:5941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 16 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.983606:0:5941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 16 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.983625:0:5941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066494208:0@lo:104: 00010000:00010000:3.0:1789760747.983654:0:5941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.983662:0:5941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 16 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.983670:0:5941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066494336:0@lo:104: 00000100:00100000:3.0:1789760747.983702:0:5941:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c18100000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760747.984177:0:5930:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789760747.984202:0:5930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.984268:0:5930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.984331:0:5930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.984352:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493824 00000100:00100000:0.0:1789760747.984362:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493824 00000100:00100000:0.0:1789760747.984411:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066493952 00000100:00100000:0.0:1789760747.984415:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066493952 00000100:00100000:0.0:1789760747.984427:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494080 00000100:00100000:0.0:1789760747.984429:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494080 00000100:00100000:0.0:1789760747.984444:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760747.984454:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c08b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+5:5941:x1876700066493824:12345-0@lo:104: 00010000:00010000:0.0:1789760747.984470:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.984634:0:5941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066493824:0@lo:104: 00010000:00010000:0.0:1789760747.984678:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760747.984686:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c08b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+5:5941:x1876700066493824:12345-0@lo:104: Request processed in 233us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.984693:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760747.984742:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760747.984750:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+4:5941:x1876700066493952:12345-0@lo:104: 00010000:00010000:0.0:1789760747.984786:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.984886:0:5941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066493952:0@lo:104: 00000100:00100000:1.0:1789760747.985055:0:5930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.985063:0:5930:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789760747.985071:0:5930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789760747.985386:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494208 00000100:00100000:3.0:1789760747.985391:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494208 00000100:00100000:3.0:1789760747.985421:0:5930:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789760747.985428:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494336 00000100:00100000:3.0:1789760747.985431:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494336 00000100:00100000:1.0:1789760747.985553:0:8011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789760747.985562:0:8011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:586668c1-4957-4570-b773-2405a941ae03+6:5941:x1876700066494080:12345-0@lo:104: 00010000:00010000:1.0:1789760747.985572:0:8011:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.985668:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789760747.985686:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.985707:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01680a00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:2.0:1789760747.985711:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.985720:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760747.985728:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760747.985734:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789760747.985881:0:5941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066494080:0@lo:104: 00010000:00010000:2.0:1789760747.986007:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986015:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760747.986045:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986053:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01680a00/0x1287b6a7b7c527cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c527d6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986069:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760747.986072:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986079:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01547c00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:2.0:1789760747.986082:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986101:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760747.986107:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760747.986113:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760747.986142:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986149:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760747.986167:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986174:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5279e expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986183:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760747.986187:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986192:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f3c00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:2.0:1789760747.986195:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986203:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760747.986209:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760747.986221:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760747.986236:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986242:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760747.986248:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986254:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f3c00/0x1287b6a7b7c5277b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52782 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986265:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760747.986267:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760747.986269:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760747.986279:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760747.986296:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066494464:0@lo:103: 00000100:00100000:2.0:1789760747.986348:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.986398:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066494592:0@lo:103: 00000100:00100000:2.0:1789760747.986422:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.986443:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760747.986449:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066494720:0@lo:103: 00000100:00100000:2.0:1789760747.986469:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.986507:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494464 00000100:00100000:2.0:1789760747.986511:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494464 00010000:00010000:2.0:1789760747.986538:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 17 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.986556:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494592 00000100:00100000:2.0:1789760747.986565:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494592 00010000:00010000:2.0:1789760747.986580:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 18 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.986591:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494720 00000100:00100000:2.0:1789760747.986594:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494720 00010000:00010000:2.0:1789760747.986605:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 19 pid: 5940 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.986618:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760747.986626:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066494464:12345-0@lo:103: 00010000:00010000:2.0:1789760747.986639:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760747.986645:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 19 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.986657:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 19 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.986794:0:5932:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760747.986805:0:5932:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789760747.986963:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760747.986971:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066494592:12345-0@lo:103: 00010000:00010000:3.0:1789760747.986981:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760747.986987:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 19 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.987042:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c527d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c527cf expref: 19 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987104:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789760747.987121:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+6:5941:x1876700066493952:12345-0@lo:104: Request processed in 2363us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.987131:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760747.987159:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760747.987168:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+5:5941:x1876700066494208:12345-0@lo:104: 00010000:00010000:0.0:1789760747.987179:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987238:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760747.987243:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+5:5941:x1876700066494208:12345-0@lo:104: Request processed in 79us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.987249:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760747.987265:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760747.987273:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+4:5941:x1876700066494336:12345-0@lo:104: 00010000:00010000:0.0:1789760747.987281:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987310:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760747.987315:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:586668c1-4957-4570-b773-2405a941ae03+4:5941:x1876700066494336:12345-0@lo:104: Request processed in 44us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.987321:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789760747.987338:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760747.987345:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987353:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f2400 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760747.987365:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987373:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760747.987380:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760747.987386:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760747.987415:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987422:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760747.987439:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987445:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f2400/0x1287b6a7b7c52751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52758 expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987457:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760747.987460:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987466:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c35325c00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760747.987470:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987476:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760747.987493:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760747.987498:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760747.987514:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987520:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760747.987525:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987532:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c35325c00/0x1287b6a7b7c52727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5272e expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.987549:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760747.987551:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760747.987552:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760747.987582:0:5941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066494208:0@lo:104: 00000100:00100000:0.0:1789760747.987594:0:5941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5941:1876700066494336:0@lo:104: 00010000:00010000:1.0:1789760747.987711:0:8011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789760747.987720:0:8011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:586668c1-4957-4570-b773-2405a941ae03+3:5941:x1876700066494080:12345-0@lo:104: Request processed in 2158us (3450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760747.987728:0:8011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789760747.987815:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066494976:0@lo:103: 00000100:00100000:1.0:1789760747.987860:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.987890:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760747.987896:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066494848:0@lo:103: 00000100:00100000:1.0:1789760747.987919:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760747.988134:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 18 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988167:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c5279e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52797 expref: 18 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988183:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760747.988235:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+17:3441:x1876700066494592:12345-0@lo:103: Request processed in 1265us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760747.988243:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760747.988264:0:5932:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760747.988273:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494976 00000100:00100000:3.0:1789760747.988279:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494976 00010000:00010000:3.0:1789760747.988299:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 17 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.988313:0:5932:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760747.988317:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066494848 00000100:00100000:3.0:1789760747.988320:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066494848 00010000:00010000:3.0:1789760747.988330:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 18 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760747.988342:0:5932:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760747.988348:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760747.988355:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+18:3441:x1876700066494720:12345-0@lo:103: 00010000:00010000:3.0:1789760747.988366:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760747.988371:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 18 pid: 5940 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988380:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 18 pid: 5940 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988390:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01546000/0x1287b6a7b7c52782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c5277b expref: 18 pid: 5940 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988408:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760747.988435:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+17:3441:x1876700066494720:12345-0@lo:103: Request processed in 79us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760747.988440:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760747.988453:0:5932:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760747.988458:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760747.988464:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+16:3440:x1876700066494976:12345-0@lo:103: 00010000:00010000:3.0:1789760747.988472:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760747.988476:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 16 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988485:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 16 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988495:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c013f3600/0x1287b6a7b7c5272e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52727 expref: 16 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988503:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760747.988533:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+15:3440:x1876700066494976:12345-0@lo:103: Request processed in 69us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760747.988539:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760747.988550:0:5932:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760747.988556:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760747.988562:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+14:3440:x1876700066494848:12345-0@lo:103: 00010000:00010000:3.0:1789760747.988570:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760747.988574:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 14 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988593:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 14 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988602:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01681000/0x1287b6a7b7c52758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52751 expref: 14 pid: 5939 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988614:0:5932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988623:0:5932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988639:0:5932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988648:0:5932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988655:0:5932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988663:0:5932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988669:0:5932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01681c00 already unused, calling callback (ffffffffc0c66350) 00010000:00010000:3.0:1789760747.988744:0:5932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988753:0:5932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988864:0:5932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760747.988876:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760747.988902:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+13:3440:x1876700066494848:12345-0@lo:103: Request processed in 340us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760747.988908:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760747.988960:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066494848:0@lo:103: 00000100:00100000:3.0:1789760747.988971:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066494976:0@lo:103: 00010000:00010000:2.0:1789760747.989158:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760747.989196:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+12:3439:x1876700066494464:12345-0@lo:103: Request processed in 2569us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760747.989202:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760747.989241:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066494464:0@lo:103: 00010000:00010000:2.0:1789760747.989262:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760747.989362:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066494720:0@lo:103: 00000100:00100000:1.0:1789760747.989373:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066494592:0@lo:103: 00010000:00010000:1.0:1789760747.989880:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760747.989950:0:5941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.989965:0:5941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.989972:0:5941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.989979:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01681c00/0x1287b6a7b7c527eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789760747.990007:0:5941:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789760747.992815:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+11:8001:x1876700066493696:12345-0@lo:253: Request processed in 17200us (17520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.992832:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789760747.993011:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066493696:0@lo:253: 10000000:01000000:1.0:1789760747.993032:0:8001:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789760747.993035:0:8001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760747.993037:0:8001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760747.993039:0:8001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760747.993040:0:8001:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789760747.993042:0:8001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760747.993043:0:8001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760747.993045:0:8001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760747.993047:0:8001:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789760747.993049:0:8001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760747.993050:0:8001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789760747.993078:0:8001:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa09c08945800 from lustre-OST0001 10000000:01000000:1.0:1789760747.993140:0:8001:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789760747.993144:0:8001:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789760747.993153:0:8001:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa09c11ff0000 local copy 10000000:01000000:1.0:1789760747.993158:0:8001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760747.993213:0:8001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760747.993225:0:8001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760747.993236:0:8001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760747.993257:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495104:0@lo:101: 00000100:00100000:1.0:1789760747.993303:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.993347:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3aec99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760747.993537:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495104 00000100:00100000:0.0:1789760747.993547:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495104 00000100:00100000:0.0:1789760747.993637:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789760747.993653:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+11:8001:x1876700066495104:12345-0@lo:101: 00010000:00010000:0.0:1789760747.993680:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760747.993699:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c527f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c527f2 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.993729:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c527f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c527f2 expref: 12 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.993741:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c527f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c527f2 expref: 12 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.993752:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35325200, rc 0) 00000100:00100000:0.0:1789760747.993846:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066495104:12345-0@lo:101: Request processed in 195us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.993854:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789760747.993938:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495104:0@lo:101: 00010000:00010000:2.0:1789760747.993955:0:8001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.993982:0:8001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.994141:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495232:0@lo:501: 00000100:00100000:2.0:1789760747.994178:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.994571:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495232 00000100:00100000:0.0:1789760747.994577:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495232 00000100:00100000:0.0:1789760747.994606:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789760747.994613:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066495232:12345-0@lo:501: 00000100:00100000:0.0:1789760747.994750:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066495232:12345-0@lo:501: Request processed in 136us (570us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760747.994787:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760747.994908:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789760747.994928:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495232:0@lo:501: 10000000:01000000:2.0:1789760747.994947:0:8001:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789760747.994970:0:8001:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789760747.994976:0:8001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.994985:0:8001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.994993:0:8001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.995022:0:8001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789760747.995059:0:8001:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa09c08945800 10000000:01000000:2.0:1789760747.995065:0:8001:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789760747.995072:0:8001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789760747.995075:0:8001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760747.995081:0:8001:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789760747.995085:0:8001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789760747.995110:0:8001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.995139:0:8001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.995148:0:8001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.995165:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495360:0@lo:101: 00000100:00100000:2.0:1789760747.995197:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.995213:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0240 going to sleep for 11 seconds 00010000:00010000:0.0:1789760747.995266:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760747.995274:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995282:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f3000 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760747.995286:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995296:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760747.995305:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760747.995311:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760747.995335:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995342:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760747.995371:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995379:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c527f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1287b6a7b7c527f9 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995393:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760747.995395:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760747.995396:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760747.995406:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760747.995425:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066495488:0@lo:103: 00000100:00100000:0.0:1789760747.995454:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760747.995488:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495360 00000100:00100000:0.0:1789760747.995493:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495360 00000100:00100000:0.0:1789760747.995516:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789760747.995523:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066495360:12345-0@lo:101: 00010000:00010000:0.0:1789760747.995533:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760747.995546:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52800 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995568:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 13 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995578:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 13 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.995589:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35325c00, rc 0) 00000100:00100000:0.0:1789760747.995617:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066495360:12345-0@lo:101: Request processed in 95us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.995623:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789760747.995650:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495488 00000100:00100000:0.0:1789760747.995654:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495488 00000100:00100000:2.0:1789760747.995800:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495360:0@lo:101: 00010000:00010000:2.0:1789760747.995812:0:8001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760747.995821:0:8001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760747.995902:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495616:0@lo:501: 00000100:00100000:2.0:1789760747.995929:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.995944:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760747.996013:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495616 00000100:00100000:1.0:1789760747.996018:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495616 00000100:00100000:1.0:1789760747.996052:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760747.996058:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066495616:12345-0@lo:501: 00000100:00100000:1.0:1789760747.996184:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066495616:12345-0@lo:501: Request processed in 126us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760747.996191:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789760747.996263:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495616:0@lo:501: 00000100:00100000:2.0:1789760747.996292:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495744:0@lo:503: 00000100:00100000:2.0:1789760747.996335:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.996364:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760747.996444:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495744 00000100:00100000:1.0:1789760747.996449:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495744 00000100:00100000:1.0:1789760747.996466:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789760747.996472:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066495744:12345-0@lo:503: 00000100:00100000:1.0:1789760747.996569:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066495744:12345-0@lo:503: Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760747.996576:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789760747.996663:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760747.996684:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+13:3442:x1876700066495488:12345-0@lo:103: 00010000:00010000:0.0:1789760747.996695:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760747.996715:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c527f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1287b6a7b7c527f2 expref: 13 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760747.996730:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760747.996790:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+12:3442:x1876700066495488:12345-0@lo:103: Request processed in 119us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760747.996797:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760747.996866:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066495488:0@lo:103: 00000100:00100000:2.0:1789760747.997113:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495744:0@lo:503: 00000040:00080000:2.0:1789760747.997460:0:8001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789760747.997567:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495872:0@lo:502: 00000100:00100000:2.0:1789760747.997614:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.997740:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760747.997929:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066495872 00000100:00100000:1.0:1789760747.997934:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066495872 00000100:00100000:1.0:1789760747.997975:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760747.997984:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066495872:12345-0@lo:502: 00000100:00100000:1.0:1789760747.998211:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066495872:12345-0@lo:502: Request processed in 227us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760747.998219:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760747.998311:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066495872:0@lo:502: 00000040:00080000:2.0:1789760747.998576:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789760747.998604:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789760747.998619:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789760747.998631:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789760747.998643:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789760747.998654:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789760747.998837:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496000:0@lo:502: 00000100:00100000:2.0:1789760747.998885:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760747.998973:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760747.999022:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496000 00000100:00100000:3.0:1789760747.999027:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496000 00000100:00100000:3.0:1789760747.999108:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789760747.999127:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066496000:12345-0@lo:502: 00000100:00100000:3.0:1789760747.999274:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066496000:12345-0@lo:502: Request processed in 156us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760747.999282:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760747.999372:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496000:0@lo:502: 00000040:00080000:2.0:1789760747.999424:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789760747.999433:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789760748.000158:0:8013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789760748.000170:0:8013:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789760748.000178:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760748.000181:0:8013:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789760748.000189:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760748.000211:0:8013:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa09c11ff3370) 00000020:00000080:1.0:1789760748.000241:0:8013:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789760748.000249:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789760748.000376:0:8013:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09c08945800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789760748.000386:0:8013:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789760748.000404:0:8013:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1287b6a7b7c52815 00010000:00010000:1.0:1789760748.011368:0:8013:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789760748.011954:0:8013:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789760748.015112:0:8013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789760748.015568:0:8013:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789760748.020900:0:8013:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789760748.021151:0:8013:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789760748.028023:0:8013:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789760748.029429:0:8013:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789760748.029446:0:8013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760748.029453:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760748.029455:0:8013:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789760748.029458:0:8013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760748.029463:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760748.029464:0:8013:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760748.029467:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760748.029469:0:8013:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789760748.029499:0:8013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760748.029502:0:8013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760748.029504:0:8013:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760748.029507:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789760748.029694:0:8001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789760748.029729:0:8001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789760748.029755:0:8001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.029799:0:8001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760748.029808:0:8001:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c08945800 from 1 10000000:01000000:2.0:1789760748.029811:0:8001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760748.029856:0:8001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.029876:0:8001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.029889:0:8001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760748.029917:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496128:0@lo:101: 00000100:00100000:2.0:1789760748.030000:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.030057:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760748.030240:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496128 00000100:00100000:1.0:1789760748.030250:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496128 00000100:00100000:1.0:1789760748.030306:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789760748.030317:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+12:8001:x1876700066496128:12345-0@lo:101: 00010000:00010000:1.0:1789760748.030332:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760748.030347:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5281c expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760748.030384:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 13 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760748.030403:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 13 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760748.030412:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c013f2200, rc 0) 00000100:00100000:1.0:1789760748.030463:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496128:12345-0@lo:101: Request processed in 147us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.030470:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760748.030580:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496128:0@lo:101: 00010000:00010000:3.0:1789760748.030596:0:8001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.030607:0:8001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.030754:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496256:0@lo:501: 00000100:00100000:3.0:1789760748.030808:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760748.030843:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496256 00000100:00100000:3.0:1789760748.030847:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496256 00000100:00100000:3.0:1789760748.030874:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789760748.030881:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496256:12345-0@lo:501: 00000100:00100000:3.0:1789760748.030988:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496256:12345-0@lo:501: Request processed in 107us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760748.030996:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789760748.031024:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c181000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760748.031037:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496256:0@lo:501: 00000100:00100000:3.0:1789760748.031063:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496384:0@lo:503: 00000100:00100000:3.0:1789760748.031103:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760748.031142:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496384 00000100:00100000:3.0:1789760748.031146:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496384 00000100:00100000:3.0:1789760748.031165:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760748.031171:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496384:12345-0@lo:503: 00000100:00100000:3.0:1789760748.031244:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496384:12345-0@lo:503: Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760748.031251:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760748.031283:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c181000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760748.031295:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496384:0@lo:503: 00000040:00080000:3.0:1789760748.031563:0:8001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760748.031645:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496512:0@lo:502: 00000100:00100000:3.0:1789760748.035130:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760748.035226:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c181000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760748.035291:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496512 00000100:00100000:2.0:1789760748.035303:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496512 00000100:00100000:2.0:1789760748.035404:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789760748.035418:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496512:12345-0@lo:502: 00000100:00100000:2.0:1789760748.035600:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496512:12345-0@lo:502: Request processed in 184us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.035609:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789760748.036913:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496512:0@lo:502: 00000040:00080000:2.0:1789760748.037216:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789760748.037252:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789760748.037296:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496640:0@lo:502: 00000100:00100000:2.0:1789760748.037374:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.037427:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789760748.037802:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496640 00000100:00100000:1.0:1789760748.037811:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496640 00000100:00100000:1.0:1789760748.037872:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760748.037884:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496640:12345-0@lo:502: 00000100:00100000:1.0:1789760748.038031:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496640:12345-0@lo:502: Request processed in 149us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.038040:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789760748.038832:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496640:0@lo:502: 00000040:00080000:2.0:1789760748.038917:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789760748.038930:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789760748.043956:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760748.043973:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760748.043976:0:8017:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789760748.043984:0:8017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09c08945800 00000020:00000080:1.0:1789760748.043987:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789760748.044004:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760748.044008:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760748.044009:0:8017:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789760748.044012:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789760748.044171:0:8001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789760748.044227:0:8001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760748.044254:0:8001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.044268:0:8001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760748.044327:0:8001:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789760748.044331:0:8001:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa09c08945800 10000000:01000000:2.0:1789760748.044334:0:8001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa09c08945800 10000000:01000000:2.0:1789760748.044339:0:8001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760748.044346:0:8001:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c08945800 from 1 10000000:01000000:2.0:1789760748.044349:0:8001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760748.044397:0:8001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.044407:0:8001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.044421:0:8001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760748.044449:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496768:0@lo:101: 00000100:00100000:2.0:1789760748.044531:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.044590:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760748.044645:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496768 00000100:00100000:1.0:1789760748.044653:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496768 00000100:00100000:1.0:1789760748.044719:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760748.044730:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8001:x1876700066496768:12345-0@lo:101: 00010000:00010000:1.0:1789760748.044747:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760748.044796:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5282a expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760748.044826:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 14 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760748.044840:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 14 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760748.044850:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c013f3000, rc 0) 00000100:00100000:1.0:1789760748.044895:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066496768:12345-0@lo:101: Request processed in 166us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.044902:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789760748.045059:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496768:0@lo:101: 00010000:00010000:2.0:1789760748.045075:0:8001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.045085:0:8001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760748.045197:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496896:0@lo:501: 00000100:00100000:2.0:1789760748.045225:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.045258:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760748.045302:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066496896 00000100:00100000:1.0:1789760748.045306:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066496896 00000100:00100000:1.0:1789760748.045339:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789760748.045346:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066496896:12345-0@lo:501: 00000100:00100000:1.0:1789760748.045462:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066496896:12345-0@lo:501: Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.045469:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760748.045535:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066496896:0@lo:501: 00000100:00100000:2.0:1789760748.045562:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066497024:0@lo:503: 00000100:00100000:2.0:1789760748.045607:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.045628:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760748.045666:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497024 00000100:00100000:1.0:1789760748.045732:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497024 00000100:00100000:1.0:1789760748.045791:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789760748.045798:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066497024:12345-0@lo:503: 00000100:00100000:1.0:1789760748.045883:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066497024:12345-0@lo:503: Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.045890:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760748.045971:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066497024:0@lo:503: 00000040:00080000:2.0:1789760748.046354:0:8001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789760748.046428:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066497152:0@lo:502: 00000100:00100000:2.0:1789760748.046468:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.046501:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c095d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760748.046604:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497152 00000100:00100000:1.0:1789760748.046609:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497152 00000100:00100000:1.0:1789760748.046648:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789760748.046655:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066497152:12345-0@lo:502: 00000100:00100000:1.0:1789760748.046837:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066497152:12345-0@lo:502: Request processed in 181us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.046845:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789760748.046944:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066497152:0@lo:502: 00000040:00080000:3.0:1789760748.047168:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789760748.047205:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789760748.047220:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789760748.047232:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789760748.047245:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789760748.047260:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789760748.047275:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789760748.047290:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789760748.047305:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789760748.047318:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789760748.047331:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789760748.047345:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789760748.047359:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789760748.047373:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789760748.047386:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789760748.047399:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789760748.047428:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789760748.047444:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789760748.047458:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789760748.047472:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789760748.047486:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789760748.047499:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789760748.047511:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789760748.047524:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789760748.047538:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789760748.047552:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789760748.047564:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789760748.047577:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789760748.047591:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789760748.047603:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789760748.047616:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789760748.047628:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789760748.047655:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789760748.047671:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789760748.048056:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789760748.048074:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789760748.048090:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789760748.048148:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066497280:0@lo:502: 00000100:00100000:3.0:1789760748.048218:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760748.048295:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c18100b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760748.048341:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497280 00000100:00100000:2.0:1789760748.048350:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497280 00000100:00100000:2.0:1789760748.048434:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789760748.048445:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066497280:12345-0@lo:502: 00000100:00100000:2.0:1789760748.048578:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066497280:12345-0@lo:502: Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.048587:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789760748.048666:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066497280:0@lo:502: 00000040:00080000:3.0:1789760748.048725:0:8001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789760748.048734:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789760748.049403:0:8018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789760748.049424:0:8018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa09c35258000) 00000020:00000080:3.0:1789760748.049450:0:8018:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789760748.049557:0:8018:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09c08945800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789760748.049562:0:8018:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09c08945800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789760748.049565:0:8018:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09c08945800 3 00010000:00080000:3.0:1789760748.049599:0:8018:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09c3f1f8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1789760748.051489:0:8018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789760748.051742:0:8018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789760748.051824:0:8018:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789760748.051839:0:8018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1287b6a7b7c5283f 00000100:00080000:3.0:1789760748.051850:0:8018:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760748.051857:0:8018:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa09c3f1f8000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1789760748.051901:0:8018:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09c04893100 x1876700066497408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760748.051935:0:8018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789760748.054796:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1876700066497408:0@lo:38: 00000100:00100000:2.0:1789760748.054907:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.055075:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1876700066497536:0@lo:400: 00000100:00100000:2.0:1789760748.055109:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.055158:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066497664:0@lo:400: 00000100:00100000:2.0:1789760748.055199:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.055219:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760748.055225:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066497792:0@lo:400: 00000100:00100000:2.0:1789760748.055253:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.055288:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497792 00000100:00100000:2.0:1789760748.055297:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497792 00000100:00100000:2.0:1789760748.055354:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760748.055366:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066497792:12345-0@lo:400: 00000100:00100000:2.0:1789760748.055427:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066497792:12345-0@lo:400: Request processed in 62us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.055436:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789760748.055486:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423800 x1876700066497792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760748.055504:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066497792:0@lo:400: 00000100:00100000:0.0:1789760748.055799:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497408 00000100:00100000:0.0:1789760748.055804:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497408 00000100:00100000:0.0:1789760748.055824:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497536 00000100:00100000:0.0:1789760748.055826:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497536 00000100:00100000:0.0:1789760748.055844:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497664 00000100:00100000:0.0:1789760748.055847:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497664 00000100:00100000:0.0:1789760748.055861:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760748.055869:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1876700066497536:12345-0@lo:400: 00000100:00100000:0.0:1789760748.055920:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1876700066497536:12345-0@lo:400: Request processed in 49us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760748.055927:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760748.055943:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760748.055948:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066497664:12345-0@lo:400: 00000100:00100000:0.0:1789760748.055982:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066497664:12345-0@lo:400: Request processed in 34us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760748.055988:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760748.055999:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760748.056003:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3438:x1876700066497408:12345-0@lo:38: 00010000:00080000:0.0:1789760748.056028:0:5947:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1789760748.056070:0:5947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1287b6a7b7c52846 00000004:00100000:0.0:1789760748.056087:0:5947:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789760748.056139:0:5947:0:(import.c:65:import_set_state_nolock()) ffffa09c3eca9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760748.056187:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3438:x1876700066497408:12345-0@lo:38: Request processed in 182us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760748.056194:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789760748.056242:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03421f80 x1876700066497536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760748.056254:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1876700066497536:0@lo:400: 00010000:00080000:0.0:1789760748.056283:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c03423480 x1876700066497664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760748.056292:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066497664:0@lo:400: 00000040:00080000:0.0:1789760748.056428:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1789760748.056567:0:8001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789760748.056603:0:8001:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760748.056620:0:8001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.056631:0:8001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789760748.057001:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c04893100 x1876700066497408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760748.057012:0:3438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760748.057020:0:3438:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789760748.057029:0:3438:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789760748.057035:0:3438:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789760748.057038:0:3438:0:(import.c:65:import_set_state_nolock()) ffffa09c3f1f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789760748.057045:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1876700066497408:0@lo:38: 00000100:00100000:1.0:1789760748.060355:0:8019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d34380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8019:1876700066497920:0@lo:901: 00000100:00100000:1.0:1789760748.060451:0:8019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760748.060497:0:8019:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5840 going to sleep for 11 seconds 00000020:01000004:0.0:1789760748.060626:0:8001:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789760748.060629:0:8001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789760748.060630:0:8001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760748.060632:0:8001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760748.060633:0:8001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760748.060635:0:8001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760748.060636:0:8001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760748.060639:0:8001:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760748.060640:0:8001:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760748.060642:0:8001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760748.060644:0:8001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760748.060650:0:8001:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789760748.060653:0:8001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789760748.060655:0:8001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789760748.060656:0:8001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760748.060657:0:8001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760748.060658:0:8001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760748.060667:0:8001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760748.060668:0:8001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760748.060669:0:8001:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760748.060670:0:8001:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760748.060739:0:8001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760748.060742:0:8001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760748.060785:0:8001:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789760748.060798:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066498048:0@lo:253: 00000100:00100000:0.0:1789760748.060841:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760748.060876:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c113136c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760748.060948:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498048 00000100:00100000:2.0:1789760748.060957:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498048 00000100:00100000:2.0:1789760748.061015:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789760748.061026:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066498048:12345-0@lo:253: 20000000:01000000:2.0:1789760748.061069:0:5940:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789760748.061086:0:5940:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789760748.061347:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066497920 00000100:00100000:3.0:1789760748.061352:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066497920 00000100:00100000:3.0:1789760748.061443:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760748.061451:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8019:x1876700066497920:12345-0@lo:901: 00000100:00100000:3.0:1789760748.061575:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8019:x1876700066497920:12345-0@lo:901: Request processed in 124us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760748.061584:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760748.061653:0:8019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09c17d34380 x1876700066497920/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789760764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760748.061670:0:8019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d34380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8019:1876700066497920:0@lo:901: 00000100:00080000:0.0:1789760748.061954:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1789760748.065530:0:5940:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789760748.065556:0:5940:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789760748.065928:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8001:x1876700066498048:12345-0@lo:253: Request processed in 4896us (5078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.065943:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 20000000:01000000:0.0:1789760748.066039:0:5962:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789760748.066046:0:5962:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789760748.066074:0:5962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.066094:0:5962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 13 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.066103:0:5962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.066159:0:5962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 13 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760748.066176:0:5962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 13 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760748.066193:0:5962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5962:1876700066498176:0@lo:104: 00000100:00100000:0.0:1789760748.066237:0:5962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760748.066289:0:5962:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c11313600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760748.066335:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:586668c1-4957-4570-b773-2405a941ae03:8001:1876700066498048:0@lo:253: 10000000:01000000:0.0:1789760748.066348:0:8001:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789760748.066366:0:8001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760748.066368:0:8001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789760748.066370:0:8001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760748.066371:0:8001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760748.066372:0:8001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760748.066374:0:8001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760748.066376:0:8001:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760748.066378:0:8001:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760748.066380:0:8001:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760748.066382:0:8001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760748.066383:0:8001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789760748.066402:0:8001:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789760748.068453:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498176 00000100:00100000:2.0:1789760748.068474:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498176 00000100:00100000:2.0:1789760748.068557:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760748.068570:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5962:x1876700066498176:12345-0@lo:104: 00010000:00010000:2.0:1789760748.068593:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.068714:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760748.068721:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:5962:x1876700066498176:12345-0@lo:104: Request processed in 154us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.068729:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789760748.068756:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760748.068783:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.068792:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01547800 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:2.0:1789760748.068797:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.068826:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760748.068835:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760748.068842:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760748.068891:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.068898:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760748.068921:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.068929:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01547800/0x1287b6a7b7c52789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52790 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.068949:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760748.068951:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760748.068953:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760748.068981:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066498304:0@lo:103: 00000100:00100000:2.0:1789760748.069031:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760748.069088:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498304 00000100:00100000:2.0:1789760748.069093:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498304 00010000:00010000:2.0:1789760748.069124:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 14 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760748.069150:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760748.069157:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c20eab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+14:3441:x1876700066498304:12345-0@lo:103: 00010000:00010000:2.0:1789760748.069177:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760748.069184:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 14 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069195:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 14 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069216:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069226:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760748.069244:0:5934:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004124392s 00010000:00010000:2.0:1789760748.069249:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069256:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069263:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069270:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069276:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c35325200 already unused, calling callback (ffffffffc0c66350) 00010000:00010000:2.0:1789760748.069280:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069288:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069306:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760748.069318:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760748.069348:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c20eab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+14:3441:x1876700066498304:12345-0@lo:103: Request processed in 192us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760748.069356:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760748.069426:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066498304:0@lo:103: 00010000:00010000:3.0:1789760748.070851:0:5962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01547200/0x1287b6a7b7c52790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52789 expref: 13 pid: 5941 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760748.070874:0:5962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5962:1876700066498176:0@lo:104: 00010000:00010000:3.0:1789760748.070901:0:5962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.070912:0:5962:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.070918:0:5962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760748.070925:0:5962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c5284d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789760748.073736:0:8001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789760748.073991:0:8001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789760748.074222:0:8001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789760748.074404:0:8001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789760748.074633:0:8001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789760748.074911:0:8001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789760748.077424:0:8001:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789760748.087167:0:8001:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789760748.087180:0:8001:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789760748.087227:0:8001:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789760748.087277:0:8001:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789760748.087316:0:8001:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789760748.087341:0:8001:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789760748.091208:0:8001:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789760748.091467:0:8001:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789760748.809227:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789760748.849643:0:8072:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789760748.850018:0:8072:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789760749.834374:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760750.856934:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760751.880874:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760752.266353:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760752.266377:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066498432:0@lo:13: 00000100:00100000:1.0:1789760752.266443:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760752.266561:0:6935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498432 00000100:00100000:0.0:1789760752.266569:0:6935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498432 00000100:00100000:0.0:1789760752.266631:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760752.266641:0:6935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066498432:12345-0@lo:13: 00002000:00000024:0.0:1789760752.266680:0:6935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789760752.266728:0:6935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066498432:12345-0@lo:13: Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760752.266735:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789760752.266790:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c17d34000 x1876700066498432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760752.266806:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066498432:0@lo:13: 00000100:00080000:1.0:1789760752.266928:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760752.904961:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760753.108653:0:8361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789760753.289279:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066498560:0@lo:400: 00000100:00100000:1.0:1789760753.289356:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760753.289406:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066499072:0@lo:400: 00000100:00100000:1.0:1789760753.289433:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760753.289458:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760753.289463:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066498688:0@lo:400: 00000100:00100000:1.0:1789760753.289483:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760753.289498:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498560 00000100:00100000:3.0:1789760753.289507:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498560 00000100:00100000:1.0:1789760753.289513:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499072 00000100:00100000:1.0:1789760753.289519:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499072 00000100:00100000:3.0:1789760753.289560:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789760753.289565:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498688 00000100:00100000:1.0:1789760753.289570:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498688 00000100:00100000:3.0:1789760753.289572:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:3439:x1876700066498560:12345-0@lo:400: 00000100:00100000:1.0:1789760753.289591:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760753.289600:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066499072:12345-0@lo:400: 00000100:00100000:3.0:1789760753.289636:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:3439:x1876700066498560:12345-0@lo:400: Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760753.289643:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789760753.289686:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066498560:0@lo:400: 00000100:00100000:3.0:1789760753.289987:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066498816:0@lo:400: 00000100:00100000:2.0:1789760753.290043:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066498944:0@lo:400: 00000100:00100000:2.0:1789760753.290090:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760753.290106:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760753.290132:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498944 00000100:00100000:2.0:1789760753.290137:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498944 00000100:00100000:2.0:1789760753.290172:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760753.290179:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066498944:12345-0@lo:400: 00000100:00100000:2.0:1789760753.290220:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066498944:12345-0@lo:400: Request processed in 41us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760753.290226:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789760753.290488:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03421c00 x1876700066498944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760753.290498:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066498944:0@lo:400: 00000100:00100000:1.0:1789760753.291276:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066499072:12345-0@lo:400: Request processed in 1674us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760753.291297:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760753.291317:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066498816 00000100:00100000:1.0:1789760753.291322:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066498816 00000100:00100000:1.0:1789760753.291351:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760753.291359:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066498688:12345-0@lo:400: 00000100:00100000:1.0:1789760753.291403:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066498688:12345-0@lo:400: Request processed in 46us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760753.291409:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760753.291421:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760753.291427:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066498816:12345-0@lo:400: 00000100:00100000:1.0:1789760753.291465:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066498816:12345-0@lo:400: Request processed in 38us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760753.291470:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789760753.291490:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789760753.292023:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03422300 x1876700066498688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760753.292037:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066498688:0@lo:400: 00010000:00080000:2.0:1789760753.292051:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03423480 x1876700066499072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760753.292072:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066499072:0@lo:400: 00010000:00080000:3.0:1789760753.292383:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03423b80 x1876700066498816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760753.292402:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066498816:0@lo:400: 00010000:00010000:1.0:1789760753.929068:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789760753.995702:0:8414:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789760753.996107:0:8414:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789760754.953011:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760755.977032:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789760756.361345:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760756.361356:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c05703000 from 30 10000000:01000000:3.0:1789760756.361363:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760756.361420:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.361434:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.361448:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.361476:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499200:0@lo:101: 00000100:00100000:3.0:1789760756.361569:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.361646:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.361673:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499200 00000100:00100000:3.0:1789760756.361682:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499200 00000100:00100000:3.0:1789760756.361742:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760756.361752:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066499200:12345-0@lo:101: 00010000:00010000:3.0:1789760756.361785:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.361811:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52854 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.361838:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 14 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.361850:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 14 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.361861:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01680400, rc 0) 00000100:00100000:3.0:1789760756.361903:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066499200:12345-0@lo:101: Request processed in 152us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.361911:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760756.361964:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499200:0@lo:101: 00010000:00010000:3.0:1789760756.361980:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.361991:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.362078:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499328:0@lo:501: 00000100:00100000:3.0:1789760756.362104:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.362119:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.362133:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499328 00000100:00100000:3.0:1789760756.362137:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499328 00000100:00100000:3.0:1789760756.362158:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789760756.362165:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066499328:12345-0@lo:501: 00000100:00100000:3.0:1789760756.362296:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066499328:12345-0@lo:501: Request processed in 130us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.362314:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789760756.362346:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499328:0@lo:501: 00000100:00100000:3.0:1789760756.362373:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499456:0@lo:503: 00000100:00100000:3.0:1789760756.362415:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.362427:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.362438:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499456 00000100:00100000:3.0:1789760756.362441:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499456 00000100:00100000:3.0:1789760756.362460:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789760756.362465:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066499456:12345-0@lo:503: 00000100:00100000:3.0:1789760756.362552:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066499456:12345-0@lo:503: Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.362558:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789760756.362614:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499456:0@lo:503: 00000100:00100000:3.0:1789760756.362847:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8497:1876700066499584:0@lo:502: 00000100:00100000:3.0:1789760756.362880:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.362898:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499584 00000100:00100000:3.0:1789760756.362902:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499584 00000100:00100000:3.0:1789760756.362922:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789760756.362928:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8497:x1876700066499584:12345-0@lo:502: 00000100:00100000:3.0:1789760756.363001:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8497:x1876700066499584:12345-0@lo:502: Request processed in 73us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.363008:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789760756.363036:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.363048:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8497:1876700066499584:0@lo:502: 00000100:00100000:3.0:1789760756.363100:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8497:1876700066499712:0@lo:502: 00000100:00100000:3.0:1789760756.363136:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.363153:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499712 00000100:00100000:3.0:1789760756.363157:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499712 00000100:00100000:3.0:1789760756.363176:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760756.363183:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8497:x1876700066499712:12345-0@lo:502: 00000100:00100000:3.0:1789760756.363238:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8497:x1876700066499712:12345-0@lo:502: Request processed in 56us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.363245:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760756.363271:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.363283:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8497:1876700066499712:0@lo:502: 00000040:00080000:3.0:1789760756.363301:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789760756.363357:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789760756.363383:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760756.363393:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363404:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760756.363415:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789760756.363418:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789760756.363421:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789760756.363444:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363452:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363462:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.363479:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499840:0@lo:101: 00000100:00100000:3.0:1789760756.363505:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.363517:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.363535:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499840 00000100:00100000:3.0:1789760756.363539:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499840 00000100:00100000:3.0:1789760756.363558:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789760756.363569:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066499840:12345-0@lo:101: 00010000:00010000:3.0:1789760756.363577:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.363590:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52862 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363611:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 15 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363622:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 15 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363631:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01680600, rc 0) 00000100:00100000:3.0:1789760756.363656:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066499840:12345-0@lo:101: Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.363663:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789760756.363690:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499840:0@lo:101: 00010000:00010000:3.0:1789760756.363701:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.363711:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.363791:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499968:0@lo:501: 00000100:00100000:3.0:1789760756.363815:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.363826:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.363836:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066499968 00000100:00100000:3.0:1789760756.363839:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066499968 00000100:00100000:3.0:1789760756.363857:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789760756.363863:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066499968:12345-0@lo:501: 00000100:00100000:3.0:1789760756.363955:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066499968:12345-0@lo:501: Request processed in 90us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.363963:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789760756.363988:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066499968:0@lo:501: 00000100:00100000:3.0:1789760756.364010:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500096:0@lo:503: 00000100:00100000:3.0:1789760756.364043:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.364069:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.364080:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500096 00000100:00100000:3.0:1789760756.364084:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500096 00000100:00100000:3.0:1789760756.364103:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760756.364108:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066500096:12345-0@lo:503: 00000100:00100000:3.0:1789760756.364175:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066500096:12345-0@lo:503: Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.364181:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760756.364216:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500096:0@lo:503: 00000100:00100000:3.0:1789760756.364494:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8498:1876700066500224:0@lo:502: 00000100:00100000:3.0:1789760756.364529:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.364553:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500224 00000100:00100000:3.0:1789760756.364557:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500224 00000100:00100000:3.0:1789760756.364577:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789760756.364583:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:8498:x1876700066500224:12345-0@lo:502: 00000100:00100000:3.0:1789760756.364653:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:8498:x1876700066500224:12345-0@lo:502: Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.364659:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789760756.364688:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.364701:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8498:1876700066500224:0@lo:502: 00000020:01000000:3.0:1789760756.364721:0:8498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760756.364733:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760756.364735:0:8498:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760756.364739:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760756.364741:0:8498:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760756.364755:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8498:1876700066500352:0@lo:502: 00000100:00100000:3.0:1789760756.364819:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.364838:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500352 00000100:00100000:3.0:1789760756.364842:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500352 00000100:00100000:3.0:1789760756.364860:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789760756.364866:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:8498:x1876700066500352:12345-0@lo:502: 00000100:00100000:3.0:1789760756.364923:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:8498:x1876700066500352:12345-0@lo:502: Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.364929:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789760756.364954:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.364965:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8498:1876700066500352:0@lo:502: 00000020:01000000:3.0:1789760756.364981:0:8498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760756.364985:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760756.364987:0:8498:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760756.364995:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789760756.365037:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789760756.370369:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789760756.370392:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.370408:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760756.370421:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760756.370424:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c1126a000 from 30 10000000:01000000:3.0:1789760756.370428:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760756.370478:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.370487:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.370500:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.370549:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500480:0@lo:101: 00000100:00100000:3.0:1789760756.370644:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.370697:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.371022:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500480 00000100:00100000:2.0:1789760756.371032:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500480 00000100:00100000:2.0:1789760756.371103:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789760756.371114:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066500480:12345-0@lo:101: 00010000:00010000:2.0:1789760756.371132:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760756.371148:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52870 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.371178:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.371191:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 16 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.371201:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01546200, rc 0) 00000100:00100000:2.0:1789760756.371250:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066500480:12345-0@lo:101: Request processed in 137us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.371257:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789760756.371412:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500480:0@lo:101: 00010000:00010000:0.0:1789760756.371430:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.371442:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760756.371531:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500608:0@lo:501: 00000100:00100000:0.0:1789760756.371563:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.371598:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3af3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.371727:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500608 00000100:00100000:3.0:1789760756.371732:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500608 00000100:00100000:3.0:1789760756.371784:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789760756.371793:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066500608:12345-0@lo:501: 00000100:00100000:3.0:1789760756.371937:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066500608:12345-0@lo:501: Request processed in 144us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.371966:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789760756.372159:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500608:0@lo:501: 00000100:00100000:0.0:1789760756.372194:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500736:0@lo:503: 00000100:00100000:0.0:1789760756.372237:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.372264:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3af3be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.372333:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500736 00000100:00100000:2.0:1789760756.372337:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500736 00000100:00100000:2.0:1789760756.372360:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789760756.372367:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066500736:12345-0@lo:503: 00000100:00100000:2.0:1789760756.372452:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066500736:12345-0@lo:503: Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.372464:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789760756.372550:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066500736:0@lo:503: 00000100:00100000:0.0:1789760756.373354:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8499:1876700066500864:0@lo:502: 00000100:00100000:0.0:1789760756.373411:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.373488:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3af3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.379461:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500864 00000100:00100000:2.0:1789760756.379482:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500864 00000100:00100000:2.0:1789760756.379677:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789760756.379691:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:8499:x1876700066500864:12345-0@lo:502: 00000100:00100000:2.0:1789760756.379942:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:8499:x1876700066500864:12345-0@lo:502: Request processed in 254us (6530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.379951:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789760756.380088:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8499:1876700066500864:0@lo:502: 00000100:00100000:1.0:1789760756.380167:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8499:1876700066500992:0@lo:502: 00000100:00100000:1.0:1789760756.380217:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.381271:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.381360:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066500992 00000100:00100000:3.0:1789760756.381369:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066500992 00000100:00100000:3.0:1789760756.381425:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789760756.381436:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:8499:x1876700066500992:12345-0@lo:502: 00000100:00100000:3.0:1789760756.381735:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:8499:x1876700066500992:12345-0@lo:502: Request processed in 300us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.381744:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789760756.382382:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8499:1876700066500992:0@lo:502: 00000040:00080000:1.0:1789760756.382725:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789760756.383007:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789760756.383033:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760756.383046:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.383072:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760756.383084:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789760756.383087:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09c1126a000 from 5 10000000:01000000:2.0:1789760756.383090:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760756.383144:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.383153:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.383164:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.383195:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501120:0@lo:101: 00000100:00100000:2.0:1789760756.383272:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.383328:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.385288:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501120 00000100:00100000:3.0:1789760756.385303:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501120 00000100:00100000:3.0:1789760756.385379:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789760756.385392:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066501120:12345-0@lo:101: 00010000:00010000:3.0:1789760756.385410:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.385433:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c52885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5287e expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.385464:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c52885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5287e expref: 17 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.385476:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01681a00/0x1287b6a7b7c52885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5287e expref: 17 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.385487:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01681a00, rc 0) 00000100:00100000:3.0:1789760756.385564:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066501120:12345-0@lo:101: Request processed in 174us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.385571:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760756.385726:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501120:0@lo:101: 00010000:00010000:2.0:1789760756.385749:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52885 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.385796:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52885 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.385873:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501248:0@lo:256: 00000100:00100000:2.0:1789760756.385931:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.385970:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.386047:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501248 00000100:00100000:3.0:1789760756.386216:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501248 00000100:00100000:3.0:1789760756.386273:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789760756.386283:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066501248:12345-0@lo:256: 20000000:01000000:3.0:1789760756.386301:0:5940:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789760756.386323:0:5940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789760756.386327:0:5940:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789760756.386430:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066501248:12345-0@lo:256: Request processed in 149us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.386438:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789760756.386512:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501248:0@lo:256: 10000000:01000000:2.0:1789760756.386562:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789760756.386571:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52885 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.386581:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01546800/0x1287b6a7b7c5287e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52885 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760756.386593:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789760756.386596:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789760756.386599:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760756.386697:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.386706:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.386729:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.386746:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501376:0@lo:101: 00000100:00100000:2.0:1789760756.386842:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.386872:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.386942:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501376 00000100:00100000:3.0:1789760756.386948:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501376 00000100:00100000:3.0:1789760756.386980:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789760756.386988:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066501376:12345-0@lo:101: 00010000:00010000:3.0:1789760756.386998:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.387011:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5288c expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.387032:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.387043:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.387876:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01680a00, rc 0) 00000100:00100000:3.0:1789760756.387946:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066501376:12345-0@lo:101: Request processed in 955us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.387953:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789760756.389352:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501376:0@lo:101: 00010000:00010000:1.0:1789760756.389379:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.389410:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.389497:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501504:0@lo:501: 00000100:00100000:1.0:1789760756.393150:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.393202:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.396001:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501504 00000100:00100000:2.0:1789760756.396023:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501504 00000100:00100000:2.0:1789760756.396121:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789760756.396132:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066501504:12345-0@lo:501: 00000100:00100000:2.0:1789760756.396356:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066501504:12345-0@lo:501: Request processed in 225us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.396364:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789760756.396557:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501504:0@lo:501: 00000100:00100000:1.0:1789760756.396638:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501632:0@lo:503: 00000100:00100000:1.0:1789760756.396698:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.396751:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.396924:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501632 00000100:00100000:2.0:1789760756.396930:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501632 00000100:00100000:2.0:1789760756.396970:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789760756.396978:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066501632:12345-0@lo:503: 00000100:00100000:2.0:1789760756.397091:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066501632:12345-0@lo:503: Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.397099:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760756.397855:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066501632:0@lo:503: 00000100:00100000:1.0:1789760756.398144:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8503:1876700066501760:0@lo:502: 00000100:00100000:1.0:1789760756.398204:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.398234:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501760 00000100:00100000:1.0:1789760756.398239:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501760 00000100:00100000:1.0:1789760756.398271:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789760756.398280:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:8503:x1876700066501760:12345-0@lo:502: 00000100:00100000:1.0:1789760756.398389:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:8503:x1876700066501760:12345-0@lo:502: Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.398397:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789760756.398444:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.398457:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8503:1876700066501760:0@lo:502: 00000020:01000000:1.0:1789760756.398479:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789760756.398488:0:8503:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789760756.398502:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.398505:0:8503:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789760756.398510:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789760756.398514:0:8503:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1789760756.398554:0:8503:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789760756.398557:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760756.398577:0:8503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa09c11ff19b8) 00000020:00000080:1.0:1789760756.398602:0:8503:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789760756.398608:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789760756.400280:0:8503:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789760756.400288:0:8503:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789760756.400300:0:8503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1287b6a7b7c528a1 00010000:00080000:1.0:1789760756.400346:0:8503:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09c0700d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1789760756.402265:0:8503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789760756.402461:0:8503:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789760756.402480:0:8503:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789760756.402696:0:8503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760756.402919:0:8503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760756.403124:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789760756.403242:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789760756.407205:0:8505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789760756.407215:0:8505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789760756.419161:0:8503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789760756.419176:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789760756.419217:0:8503:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789760756.419245:0:8503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1287b6a7b7c528a8 00000100:00080000:3.0:1789760756.419255:0:8503:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760756.419260:0:8503:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa09c0700d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1789760756.419297:0:8503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09c04892a00 x1876700066501888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760756.419319:0:8503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789760756.419392:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760756.419396:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760756.419398:0:8503:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789760756.419401:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760756.419407:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760756.419409:0:8503:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760756.419413:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760756.419414:0:8503:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760756.419449:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8503:1876700066502016:0@lo:502: 00000100:00100000:3.0:1789760756.419529:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.419582:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502016 00000100:00100000:3.0:1789760756.419589:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502016 00000100:00100000:3.0:1789760756.419630:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789760756.419639:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:8503:x1876700066502016:12345-0@lo:502: 00000100:00100000:3.0:1789760756.420103:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:8503:x1876700066502016:12345-0@lo:502: Request processed in 463us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.420114:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789760756.420179:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08be86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.420200:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8503:1876700066502016:0@lo:502: 00000020:01000000:3.0:1789760756.420235:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760756.420242:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760756.420244:0:8503:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760756.420248:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789760756.420358:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789760756.420401:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789760756.420416:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.420430:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760756.420442:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789760756.420455:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa09c11ff0000 from 1 10000000:01000000:1.0:1789760756.420458:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760756.420501:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.420510:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.420522:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.420545:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066502400:0@lo:101: 00000100:00100000:1.0:1789760756.420686:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.420728:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.421874:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066502144:0@lo:400: 00000100:00100000:3.0:1789760756.421931:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.421965:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760756.421972:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1876700066502656:0@lo:400: 00000100:00100000:3.0:1789760756.422002:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.422035:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066502272:0@lo:400: 00000100:00100000:3.0:1789760756.422070:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.422089:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760756.422096:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066502528:0@lo:400: 00000100:00100000:3.0:1789760756.422121:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.422157:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502144 00000100:00100000:3.0:1789760756.422163:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502144 00000100:00100000:3.0:1789760756.422197:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502656 00000100:00100000:3.0:1789760756.422201:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502656 00000100:00100000:3.0:1789760756.422238:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502272 00000100:00100000:3.0:1789760756.422242:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502272 00000100:00100000:3.0:1789760756.422257:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760756.422263:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066502144:12345-0@lo:400: 00000100:00100000:3.0:1789760756.422311:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1876700066502144:12345-0@lo:400: Request processed in 48us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.422319:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760756.422334:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760756.422341:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1876700066502656:12345-0@lo:400: 00000100:00100000:3.0:1789760756.422370:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1876700066502656:12345-0@lo:400: Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.422376:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760756.422388:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760756.422394:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066502272:12345-0@lo:400: 00000100:00100000:3.0:1789760756.422436:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066502272:12345-0@lo:400: Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.422442:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760756.422464:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502528 00000100:00100000:3.0:1789760756.422468:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502528 00000100:00100000:3.0:1789760756.422497:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760756.422503:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066502528:12345-0@lo:400: 00000100:00100000:2.0:1789760756.423689:0:3438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1876700066501888:0@lo:8: 00000100:00100000:2.0:1789760756.423738:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.423805:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502400 00000100:00100000:2.0:1789760756.423810:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502400 00000100:00100000:2.0:1789760756.423842:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789760756.423850:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066502400:12345-0@lo:101: 00010000:00010000:2.0:1789760756.423867:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760756.423884:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c528af expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.423909:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 19 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.423921:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 19 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.423931:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01547a00, rc 0) 00000100:00100000:2.0:1789760756.423967:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066502400:12345-0@lo:101: Request processed in 117us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.423973:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789760756.424021:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066502400:0@lo:101: 00010000:00010000:2.0:1789760756.424038:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.424048:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.424126:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066502784:0@lo:501: 00000100:00100000:2.0:1789760756.424153:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.424169:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.424684:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066502528:12345-0@lo:400: Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.424693:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760756.424712:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066501888 00000100:00100000:3.0:1789760756.424716:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066501888 00000100:00100000:3.0:1789760756.424797:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760756.424803:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3438:x1876700066501888:12345-0@lo:8: 00010000:00080000:3.0:1789760756.424829:0:6933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1789760756.424859:0:6933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1287b6a7b7c528bd 00002000:00100000:3.0:1789760756.424873:0:6933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa09c3f1fc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789760756.424877:0:6933:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789760756.424880:0:6933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789760756.424947:0:6933:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789760756.425216:0:6933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789760756.425240:0:6933:0:(import.c:65:import_set_state_nolock()) ffffa09c3f1fa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760756.425300:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3438:x1876700066501888:12345-0@lo:8: Request processed in 495us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.425307:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789760756.425381:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04892a00 x1876700066501888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760756.425398:0:3438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760756.425410:0:3438:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789760756.425421:0:3438:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789760756.425429:0:3438:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789760756.425433:0:3438:0:(import.c:65:import_set_state_nolock()) ffffa09c0700d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789760756.425462:0:3438:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789760756.425471:0:3438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1876700066501888:0@lo:8: 00000004:00080000:1.0:1789760756.425516:0:8505:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789760756.425604:0:8505:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 210464841128ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789760756.425906:0:8505:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1789760756.427687:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760756.427695:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789760756.427743:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03416a00 x1876700066502656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760756.427803:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1876700066502656:0@lo:400: 00010000:00080000:2.0:1789760756.427828:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03417100 x1876700066502144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760756.427837:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1876700066502144:0@lo:400: 00010000:00080000:2.0:1789760756.427882:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03414380 x1876700066502528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760756.427891:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066502528:0@lo:400: 00010000:00080000:2.0:1789760756.427903:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03415500 x1876700066502272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760756.427911:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066502272:0@lo:400: 00000004:00080000:2.0:1789760756.429357:0:5926:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789760756.429498:0:8508:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789760756.429524:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503040:0@lo:7: 00000100:00100000:0.0:1789760756.430128:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.430158:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3af3b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.430224:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503040 00000100:00100000:3.0:1789760756.430231:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503040 00000100:00100000:3.0:1789760756.430265:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502784 00000100:00100000:3.0:1789760756.430268:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502784 00000100:00100000:3.0:1789760756.430317:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789760756.430327:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066502784:12345-0@lo:501: 00000100:00100000:3.0:1789760756.430424:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066502784:12345-0@lo:501: Request processed in 97us (6268us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760756.430432:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789760756.430491:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03423480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066502784:0@lo:501: 10000000:01000000:3.0:1789760756.430531:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760756.430540:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.430551:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.430597:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760756.430603:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8508:x1876700066503040:12345-0@lo:7: 00000100:00100000:2.0:1789760756.433218:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760756.433246:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066502912:0@lo:13: 00000100:00100000:2.0:1789760756.433318:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760756.436830:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760756.436926:0:6935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066502912 00000100:00100000:0.0:1789760756.436938:0:6935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066502912 00000100:00100000:0.0:1789760756.437002:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760756.437013:0:6935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1876700066502912:12345-0@lo:13: 00002000:00000024:0.0:1789760756.437041:0:6935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923857408 avail 3692335104 00000100:00100000:0.0:1789760756.437204:0:6935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1876700066502912:12345-0@lo:13: Request processed in 192us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.437213:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789760756.437251:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03415880 x1876700066502912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760756.437274:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066502912:0@lo:13: 00002000:00080000:3.0:1789760756.439377:0:6933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789760756.439387:0:6933:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789760756.439463:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8508:x1876700066503040:12345-0@lo:7: Request processed in 8856us (9332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.439474:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789760756.439504:0:8508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03415f80 x1876700066503040/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760756.439518:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503040:0@lo:7: 00000004:00080000:0.0:1789760756.439530:0:8508:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789760756.439561:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503168:0@lo:5: 00000100:00100000:0.0:1789760756.439590:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.439626:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3af3b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.439796:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503168 00000100:00100000:3.0:1789760756.439802:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503168 00000100:00100000:3.0:1789760756.439846:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760756.439855:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8508:x1876700066503168:12345-0@lo:5: 00002000:00080000:3.0:1789760756.439881:0:6974:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789760756.439884:0:6974:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1789760756.442404:0:8002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789760756.442420:0:8002:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789760756.442575:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8508:x1876700066503168:12345-0@lo:5: Request processed in 2716us (2978us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789760756.442585:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789760756.442924:0:8508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03415f80 x1876700066503168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760756.442935:0:8508:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789760756.442941:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503168:0@lo:5: 00000004:00080000:0.0:1789760756.442963:0:8508:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789760756.443005:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503296:0@lo:700: 00000100:00100000:0.0:1789760756.443038:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.443086:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3af3b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.443129:0:6939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503296 00000100:00100000:3.0:1789760756.443136:0:6939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503296 00000100:00100000:3.0:1789760756.443189:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760756.443199:0:6939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8508:x1876700066503296:12345-0@lo:700: 00000100:00100000:3.0:1789760756.443245:0:6939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6939:1876700066503424:0@lo:700: 00000100:00100000:3.0:1789760756.443275:0:6939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.443293:0:6939:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08be8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.443300:0:5953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503424 00000100:00100000:0.0:1789760756.443305:0:5953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503424 00000100:00100000:0.0:1789760756.443395:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760756.443403:0:5953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6939:x1876700066503424:12345-0@lo:700: 40000000:02000000:0.0:1789760756.448805:0:5953:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789760756.455434:0:5953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6939:x1876700066503424:12345-0@lo:700: Request processed in 12024us (12150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.455447:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789760756.455872:0:6939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04891880 x1876700066503424/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760756.455888:0:6939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6939:1876700066503424:0@lo:700: 40000000:02000000:3.0:1789760756.455902:0:6939:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1789760756.477079:0:6939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8508:x1876700066503296:12345-0@lo:700: Request processed in 33873us (34031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.477093:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789760756.477196:0:8508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c03415f80 x1876700066503296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760756.477212:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503296:0@lo:700: 00000004:02000040:3.0:1789760756.480926:0:8508:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789760756.486707:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503552:0@lo:5: 00000100:00100000:3.0:1789760756.486800:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.487021:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c08be8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.487650:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503552 00000100:00100000:2.0:1789760756.487657:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503552 00000100:00100000:2.0:1789760756.487716:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760756.487725:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8508:x1876700066503552:12345-0@lo:5: 00002000:00080000:2.0:1789760756.490833:0:6932:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789760756.490851:0:6932:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789760756.494681:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8508:x1876700066503552:12345-0@lo:5: Request processed in 6950us (7874us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789760756.494694:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789760756.494931:0:8508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04891880 x1876700066503552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760756.494947:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8508:1876700066503552:0@lo:5: 00000004:00080000:3.0:1789760756.494960:0:8508:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000020:00000004:3.0:1789760756.513165:0:8521:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760756.513369:0:8521:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789760757.003904:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789760757.228611:0:8569:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760757.228621:0:8569:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789760757.386034:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760757.386067:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066503680:0@lo:13: 00000100:00100000:3.0:1789760757.386131:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760757.386190:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503680 00000100:00100000:3.0:1789760757.386197:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503680 00000100:00100000:3.0:1789760757.386237:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760757.386246:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066503680:12345-0@lo:13: 00002000:00000024:3.0:1789760757.386271:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760757.386310:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066503680:12345-0@lo:13: Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760757.386317:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789760757.386350:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04890a80 x1876700066503680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760757.386367:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066503680:0@lo:13: 00010000:00010000:1.0:1789760758.026467:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760758.671082:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760758.671186:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048654720 00000100:00100000:2.0:1789760758.671196:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048654720 00000100:00100000:2.0:1789760758.671285:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1789760758.671293:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1876700048654720:12345-192.168.203.13@tcp:250: 00010000:00080000:2.0:1789760758.671320:0:5939:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea@192.168.203.13@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1789760758.671345:0:5939:0:(genops.c:1385:class_connect()) connect: client 735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea, cookie 0x1287b6a7b7c528c4 00000100:00080000:2.0:1789760758.671464:0:5939:0:(import.c:65:import_set_state_nolock()) ffffa09c11324000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760758.671533:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+5:2358:x1876700048654720:12345-192.168.203.13@tcp:250: Request processed in 239us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.671541:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:3.0:1789760758.675648:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760758.675795:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048654592 00000100:00100000:0.0:1789760758.675804:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048654592 00000100:00100000:0.0:1789760758.675855:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1789760758.675864:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+5:5431:x1876700048654592:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1789760758.675879:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.675894:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c561ae expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.675921:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 6 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.675950:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 6 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.675959:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35325200, rc 0) 00000100:00100000:0.0:1789760758.676017:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+6:5431:x1876700048654592:12345-192.168.203.13@tcp:101: Request processed in 153us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.676024:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1789760758.679279:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760758.679377:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048654848 00000100:00100000:2.0:1789760758.679386:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048654848 00000100:00100000:2.0:1789760758.679478:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:2.0:1789760758.679488:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+6:5431:x1876700048654848:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1789760758.679614:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+6:5431:x1876700048654848:12345-192.168.203.13@tcp:501: Request processed in 127us (344us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760758.679622:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:1.0:1789760758.685579:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.685742:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048654976 00000100:00100000:3.0:1789760758.685752:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048654976 00000100:00100000:3.0:1789760758.685835:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1789760758.685844:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+6:5431:x1876700048654976:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1789760758.685860:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760758.685876:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c561b5 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.685903:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 7 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.685915:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 7 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.685936:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11feec00, rc 0) 00000100:00100000:3.0:1789760758.685997:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+7:5431:x1876700048654976:12345-192.168.203.13@tcp:101: Request processed in 153us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.686004:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1789760758.688140:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760758.689545:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655104 00000100:00100000:2.0:1789760758.689558:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655104 00000100:00100000:2.0:1789760758.691243:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:2.0:1789760758.691259:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+7:5431:x1876700048655104:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1789760758.691527:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5431:x1876700048655104:12345-192.168.203.13@tcp:501: Request processed in 271us (3392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.691536:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:2.0:1789760758.695211:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760758.695300:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655232 00000100:00100000:0.0:1789760758.695309:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655232 00000100:00100000:0.0:1789760758.695364:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:0.0:1789760758.695374:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5431:x1876700048655232:12345-192.168.203.13@tcp:503: 00000100:00100000:0.0:1789760758.695529:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5431:x1876700048655232:12345-192.168.203.13@tcp:503: Request processed in 156us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.695546:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1789760758.705944:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760758.706051:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655360 00000100:00100000:2.0:1789760758.706061:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655360 00000100:00100000:2.0:1789760758.706117:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1789760758.706127:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5449:x1876700048655360:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1789760758.706406:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5449:x1876700048655360:12345-192.168.203.13@tcp:502: Request processed in 279us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.706414:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1789760758.742475:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.742720:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655488 00000100:00100000:3.0:1789760758.742730:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655488 00000100:00100000:3.0:1789760758.742803:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:3.0:1789760758.742812:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5449:x1876700048655488:12345-192.168.203.13@tcp:502: 00000100:00100000:3.0:1789760758.742958:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5449:x1876700048655488:12345-192.168.203.13@tcp:502: Request processed in 147us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.742966:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:3.0:1789760758.745183:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760758.745275:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655616 00000100:00100000:2.0:1789760758.745283:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655616 00000100:00100000:2.0:1789760758.745333:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1789760758.745343:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5431:x1876700048655616:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1789760758.745358:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.745375:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c01547800/0x1287b6a7b7c528d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c561df expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.745401:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c01547800/0x1287b6a7b7c528d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561df expref: 9 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.745412:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c01547800/0x1287b6a7b7c528d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561df expref: 9 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.745440:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c01547800, rc 0) 00000100:00100000:2.0:1789760758.745499:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5431:x1876700048655616:12345-192.168.203.13@tcp:101: Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.745506:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:1.0:1789760758.748018:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760758.748157:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655744 00000100:00100000:0.0:1789760758.748165:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655744 00000100:00100000:0.0:1789760758.748219:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1789760758.748228:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5431:x1876700048655744:12345-192.168.203.13@tcp:256: 20000000:01000000:0.0:1789760758.748251:0:5940:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789760758.748272:0:5940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789760758.748276:0:5940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789760758.748279:0:5940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789760758.748281:0:5940:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789760758.749947:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5431:x1876700048655744:12345-192.168.203.13@tcp:256: Request processed in 1712us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.749959:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:1.0:1789760758.752204:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.752372:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048655872 00000100:00100000:3.0:1789760758.752381:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048655872 00000100:00100000:3.0:1789760758.752476:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1789760758.752487:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5431:x1876700048655872:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1789760758.752502:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760758.752518:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c561e6 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.752543:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.752555:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.752579:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11feea00, rc 0) 00000100:00100000:3.0:1789760758.752644:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5431:x1876700048655872:12345-192.168.203.13@tcp:101: Request processed in 158us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.752650:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1789760758.761340:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.761563:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656000 00000100:00100000:3.0:1789760758.761573:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656000 00000100:00100000:3.0:1789760758.761688:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1789760758.761700:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5431:x1876700048656000:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1789760758.761879:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5431:x1876700048656000:12345-192.168.203.13@tcp:501: Request processed in 181us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.761888:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1789760758.763860:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.763959:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656128 00000100:00100000:3.0:1789760758.763966:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656128 00000100:00100000:3.0:1789760758.764069:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:3.0:1789760758.764078:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5431:x1876700048656128:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1789760758.764197:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5431:x1876700048656128:12345-192.168.203.13@tcp:503: Request processed in 118us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.764204:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1789760758.768332:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760758.768444:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656256 00000100:00100000:2.0:1789760758.768454:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656256 00000100:00100000:2.0:1789760758.768542:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1789760758.768552:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5454:x1876700048656256:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1789760758.768710:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5454:x1876700048656256:12345-192.168.203.13@tcp:502: Request processed in 158us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.768718:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1789760758.771361:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.771461:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656384 00000100:00100000:3.0:1789760758.771470:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656384 00000100:00100000:0.0:1789760758.771655:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1789760758.771666:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5454:x1876700048656384:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1789760758.771863:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5454:x1876700048656384:12345-192.168.203.13@tcp:502: Request processed in 199us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.771872:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1789760758.774866:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760758.774940:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656512 00000100:00100000:3.0:1789760758.774949:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656512 00000100:00100000:3.0:1789760758.774991:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1789760758.775000:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1876700048656512:12345-192.168.203.13@tcp:38: 00010000:00080000:3.0:1789760758.775024:0:5946:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c2c87d9a-ec5f-46cf-8e98-545b26703d9f@192.168.203.13@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1789760758.775216:0:5946:0:(genops.c:1385:class_connect()) connect: client c2c87d9a-ec5f-46cf-8e98-545b26703d9f, cookie 0x1287b6a7b7c528e7 00000004:00100000:3.0:1789760758.775240:0:5946:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789760758.775246:0:5946:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789760758.779524:0:5946:0:(import.c:65:import_set_state_nolock()) ffffa09c3f1ff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760758.779663:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2358:x1876700048656512:12345-192.168.203.13@tcp:38: Request processed in 4660us (4803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.779673:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:2.0:1789760759.048957:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760759.794322:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760759.794549:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760759.795646:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656768 00000100:00100000:0.0:1789760759.795658:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656768 00000100:00100000:3.0:1789760759.795722:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656640 00000100:00100000:3.0:1789760759.795736:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656640 00000100:00100000:0.0:1789760759.795812:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1789760759.795831:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:5431:x1876700048656768:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1789760759.795869:0:5947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1789760759.795954:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:5431:x1876700048656768:12345-192.168.203.13@tcp:41: Request processed in 130us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760759.795963:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1789760759.795984:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1789760759.795990:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:0:x1876700048656640:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1789760759.796002:0:5947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1789760759.796020:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:0:x1876700048656640:12345-192.168.203.13@tcp:41: Request processed in 31us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760759.796036:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:2.0:1789760759.796940:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760759.803950:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760759.806719:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048656896 00000100:00100000:3.0:1789760759.806740:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048656896 00000100:00100000:3.0:1789760759.806931:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1789760759.806946:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5431:x1876700048656896:12345-192.168.203.13@tcp:40: 00000100:00100000:3.0:1789760759.807283:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5431:x1876700048656896:12345-192.168.203.13@tcp:40: Request processed in 340us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760759.807293:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1789760759.814340:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760759.814439:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760759.814477:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657024 00000100:00100000:2.0:1789760759.814496:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657024 00000100:00100000:2.0:1789760759.814577:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1789760759.814585:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1876700048657024:12345-192.168.203.13@tcp:8: 00010000:00080000:2.0:1789760759.814615:0:6931:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c2c87d9a-ec5f-46cf-8e98-545b26703d9f@192.168.203.13@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1789760759.814645:0:6931:0:(genops.c:1385:class_connect()) connect: client c2c87d9a-ec5f-46cf-8e98-545b26703d9f, cookie 0x1287b6a7b7c528ee 00002000:00100000:2.0:1789760759.814657:0:6931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2c87d9a-ec5f-46cf-8e98-545b26703d9f/ffffa09c3eccc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760759.814692:0:6931:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760759.814912:0:6931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789760759.814944:0:6931:0:(import.c:65:import_set_state_nolock()) ffffa09c3ecca000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760759.815013:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2358:x1876700048657024:12345-192.168.203.13@tcp:8: Request processed in 427us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760759.815020:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1789760759.817427:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657280 00000100:00100000:3.0:1789760759.817447:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657280 00000100:00100000:1.0:1789760759.818801:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760759.818860:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760759.819572:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657408 00000100:00100000:0.0:1789760759.819594:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657408 00000100:00100000:0.0:1789760759.819676:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1789760759.819706:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5431:x1876700048657408:12345-192.168.203.13@tcp:33: 00000100:00100000:3.0:1789760759.820789:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657152 00000100:00100000:3.0:1789760759.820804:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657152 00000100:00100000:2.0:1789760759.824023:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1789760759.824053:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2360:x1876700048657280:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1789760759.824311:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2360:x1876700048657280:12345-192.168.203.13@tcp:400: Request processed in 261us (9871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760759.824320:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1789760759.824925:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1789760759.824934:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1876700048657152:12345-192.168.203.13@tcp:8: 00010000:00080000:2.0:1789760759.824968:0:6932:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c2c87d9a-ec5f-46cf-8e98-545b26703d9f@192.168.203.13@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1789760759.825013:0:6932:0:(genops.c:1385:class_connect()) connect: client c2c87d9a-ec5f-46cf-8e98-545b26703d9f, cookie 0x1287b6a7b7c528f5 00002000:00100000:2.0:1789760759.825047:0:6932:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2c87d9a-ec5f-46cf-8e98-545b26703d9f/ffffa09c3ecc8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760759.825080:0:6932:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760759.825326:0:6932:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760759.825368:0:6932:0:(import.c:65:import_set_state_nolock()) ffffa09c3eccf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760759.825431:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2358:x1876700048657152:12345-192.168.203.13@tcp:8: Request processed in 495us (6569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760759.825440:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000004:00080000:2.0:1789760759.837081:0:5949:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17233us 00000004:00200000:2.0:1789760759.851047:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789760759.851169:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5431:x1876700048657408:12345-192.168.203.13@tcp:33: Request processed in 31461us (32403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760759.851184:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1789760760.015341:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760760.016864:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657536 00000100:00100000:0.0:1789760760.016878:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657536 00000100:00100000:0.0:1789760760.016957:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1789760760.016969:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5471:x1876700048657536:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1789760760.016989:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760760.017051:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324600/0x1287b6a7b7c528fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c56210 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.017116:0:5947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324000/0x1287b6a7b7c52903 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.017129:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324000/0x1287b6a7b7c52903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.017143:0:5947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324000/0x1287b6a7b7c52903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760760.017186:0:5947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789760760.017190:0:5947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760760.017206:0:5947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324000/0x1287b6a7b7c52903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.017230:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324600/0x1287b6a7b7c528fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56210 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.017250:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa09c35324000/0x1287b6a7b7c52903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56210 expref: 7 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.017258:0:5947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa09c0881b700) 00010000:00010000:0.0:1789760760.017278:0:5947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760760.017283:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35324000, rc 0) 00000100:00100000:0.0:1789760760.017358:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:5471:x1876700048657536:12345-192.168.203.13@tcp:101: Request processed in 390us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.017367:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:1.0:1789760760.072996:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760761.097031:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760761.481782:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760761.481807:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066503808:0@lo:13: 00000100:00100000:2.0:1789760761.481876:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760761.482346:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503808 00000100:00100000:3.0:1789760761.482355:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503808 00000100:00100000:3.0:1789760761.482421:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760761.482431:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1876700066503808:12345-0@lo:13: 00002000:00000024:3.0:1789760761.482460:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760761.482505:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1876700066503808:12345-0@lo:13: Request processed in 76us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.482512:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789760761.482738:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04890a80 x1876700066503808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760761.482758:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066503808:0@lo:13: 00000100:00080000:2.0:1789760761.482809:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760761.483087:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066504192:0@lo:400: 00000100:00100000:1.0:1789760761.483127:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.483149:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760761.483155:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066504320:0@lo:400: 00000100:00100000:1.0:1789760761.483178:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760761.483517:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066503936:0@lo:400: 00000100:00100000:2.0:1789760761.483569:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760761.483602:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066504448:0@lo:400: 00000100:00100000:2.0:1789760761.483624:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760761.483643:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760761.483648:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066504064:0@lo:400: 00000100:00100000:2.0:1789760761.483685:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760761.483731:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504192 00000100:00100000:2.0:1789760761.483736:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504192 00000100:00100000:2.0:1789760761.483791:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504448 00000100:00100000:2.0:1789760761.483794:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504448 00000100:00100000:2.0:1789760761.483809:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504064 00000100:00100000:2.0:1789760761.483811:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504064 00000100:00100000:2.0:1789760761.483824:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760761.483831:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066504192:12345-0@lo:400: 00000100:00100000:2.0:1789760761.483867:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066504192:12345-0@lo:400: Request processed in 36us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760761.483881:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760761.483897:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760761.483903:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066504448:12345-0@lo:400: 00000100:00100000:2.0:1789760761.483936:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066504448:12345-0@lo:400: Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760761.483941:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760761.483952:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760761.483958:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066504064:12345-0@lo:400: 00000100:00100000:2.0:1789760761.483996:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066504064:12345-0@lo:400: Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760761.484001:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760761.484044:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066504064:0@lo:400: 00000100:00100000:2.0:1789760761.484055:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066504448:0@lo:400: 00000100:00080000:2.0:1789760761.484076:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760761.484683:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066504192:0@lo:400: 00000100:00100000:0.0:1789760761.484799:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066503936 00000100:00100000:0.0:1789760761.484804:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066503936 00000100:00100000:0.0:1789760761.484838:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789760761.484845:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066503936:12345-0@lo:400: 00000100:00100000:0.0:1789760761.484891:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066503936:12345-0@lo:400: Request processed in 46us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760761.484898:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789760761.484939:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066503936:0@lo:400: 00000100:00100000:2.0:1789760761.485173:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504320 00000100:00100000:2.0:1789760761.485178:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504320 00000100:00100000:2.0:1789760761.485297:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760761.485305:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066504320:12345-0@lo:400: 00000100:00100000:2.0:1789760761.485353:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066504320:12345-0@lo:400: Request processed in 49us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760761.485360:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789760761.485434:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede0a80 x1876700066504320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760761.485445:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066504320:0@lo:400: 00000100:00080000:0.0:1789760761.485542:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760761.909603:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760761.909751:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657664 00000100:00100000:1.0:1789760761.909783:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657664 00000100:00100000:1.0:1789760761.909869:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1789760761.909878:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:5523:x1876700048657664:12345-192.168.203.13@tcp:41: 00000004:00000024:1.0:1789760761.909927:0:5946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1789760761.909988:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:5523:x1876700048657664:12345-192.168.203.13@tcp:41: Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760761.910022:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1789760761.910200:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760761.917192:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760761.917597:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657792 00000100:00100000:3.0:1789760761.917607:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657792 00000100:00100000:3.0:1789760761.917737:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1789760761.917749:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5523:x1876700048657792:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1789760761.917799:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760761.917865:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5523:x1876700048657792:12345-192.168.203.13@tcp:13: Request processed in 118us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.917872:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:0.0:1789760761.918507:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760761.928217:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760761.928526:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048657920 00000100:00100000:3.0:1789760761.928536:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048657920 00000100:00100000:3.0:1789760761.928612:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1789760761.928623:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5523:x1876700048657920:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1789760761.928648:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1789760761.928785:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760761.930226:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:5523:x1876700048657920:12345-192.168.203.13@tcp:13: Request processed in 1597us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.930239:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000001:00100000:0.0:1789760761.997312:0:8002:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00000001:00080000:0.0:1789760761.997329:0:8002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789760762.123967:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760762.508749:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066504576:0@lo:13: 00000100:00100000:1.0:1789760762.508834:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760762.508905:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504576 00000100:00100000:1.0:1789760762.508912:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504576 00000100:00100000:1.0:1789760762.508969:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789760762.508977:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066504576:12345-0@lo:13: 00002000:00000024:1.0:1789760762.508998:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760762.509065:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066504576:12345-0@lo:13: Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760762.509073:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789760762.509111:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede2d80 x1876700066504576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760762.509130:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066504576:0@lo:13: 00010000:00010000:2.0:1789760763.146617:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760763.976152:0:8667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789760764.168964:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760764.942905:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760764.942965:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760764.943001:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658176 00000100:00100000:3.0:1789760764.943019:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658176 00000100:00100000:2.0:1789760764.943038:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760764.943086:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760764.943139:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658304 00000100:00100000:1.0:1789760764.943150:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658304 00000100:00100000:3.0:1789760764.943330:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1789760764.943343:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:2362:x1876700048658176:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1789760764.943431:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+7:2362:x1876700048658176:12345-192.168.203.13@tcp:400: Request processed in 92us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.943440:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1789760764.943525:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658048 00000100:00100000:0.0:1789760764.943531:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658048 00000100:00100000:0.0:1789760764.943581:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:0.0:1789760764.943591:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048658048:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1789760764.943653:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048658048:12345-192.168.203.13@tcp:400: Request processed in 64us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760764.943659:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:0.0:1789760764.943871:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658432 00000100:00100000:0.0:1789760764.943893:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658432 00000100:00100000:0.0:1789760764.947336:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1789760764.947354:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2362:x1876700048658432:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1789760764.947450:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2362:x1876700048658432:12345-192.168.203.13@tcp:400: Request processed in 102us (4364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760764.947458:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:0.0:1789760764.950271:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760764.950286:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760764.950291:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760764.950487:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1789760764.950505:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2361:x1876700048658304:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1789760764.950649:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2361:x1876700048658304:12345-192.168.203.13@tcp:400: Request processed in 150us (7610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760764.950658:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000001:00100000:2.0:1789760765.073549:0:5926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00010000:00010000:3.0:1789760765.194370:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789760766.092974:0:6926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00010000:00010000:2.0:1789760766.220309:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760766.601207:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066504704:0@lo:13: 00000100:00100000:2.0:1789760766.601307:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760766.601465:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504704 00000100:00100000:3.0:1789760766.601490:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504704 00000100:00100000:3.0:1789760766.601626:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789760766.601639:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066504704:12345-0@lo:13: 00002000:00000024:3.0:1789760766.601675:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760766.601729:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066504704:12345-0@lo:13: Request processed in 92us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760766.601737:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789760766.603257:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04890000 x1876700066504704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760766.603276:0:3441:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789760766.603318:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066504704:0@lo:13: 00000100:00100000:3.0:1789760766.604276:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066504960:0@lo:400: 00000100:00100000:3.0:1789760766.604364:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760766.604407:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760766.604414:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066505088:0@lo:400: 00000100:00100000:3.0:1789760766.604474:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760766.604518:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504960 00000100:00100000:3.0:1789760766.604525:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504960 00000100:00100000:3.0:1789760766.604587:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066505088 00000100:00100000:3.0:1789760766.604591:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066505088 00000100:00100000:2.0:1789760766.605694:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789760766.605714:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066504960:12345-0@lo:400: 00000100:00100000:2.0:1789760766.605855:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066504960:12345-0@lo:400: Request processed in 148us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.605864:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789760766.605929:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066504960:0@lo:400: 00000100:00100000:2.0:1789760766.605964:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066505216:0@lo:400: 00000100:00100000:2.0:1789760766.606014:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.606045:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789760766.606052:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066504832:0@lo:400: 00000100:00100000:2.0:1789760766.606081:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.606110:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066505344:0@lo:400: 00000100:00100000:2.0:1789760766.606131:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.606159:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066505216 00000100:00100000:2.0:1789760766.606176:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066505216 00000100:00080000:0.0:1789760766.607059:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760766.607066:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760766.607070:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760766.607245:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066504832 00000100:00100000:0.0:1789760766.607252:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066504832 00000100:00100000:0.0:1789760766.607307:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789760766.607317:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066504832:12345-0@lo:400: 00000100:00100000:0.0:1789760766.607390:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066504832:12345-0@lo:400: Request processed in 74us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760766.607398:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789760766.607518:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066505344 00000100:00100000:0.0:1789760766.607523:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066505344 00000100:00100000:0.0:1789760766.607632:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760766.607639:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066505344:12345-0@lo:400: 00000100:00100000:0.0:1789760766.607674:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066505344:12345-0@lo:400: Request processed in 36us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760766.607681:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789760766.607697:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760766.608323:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760766.608335:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066505088:12345-0@lo:400: 00000100:00100000:3.0:1789760766.608391:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066505088:12345-0@lo:400: Request processed in 59us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760766.608398:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760766.608582:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066504832:0@lo:400: 00000100:00100000:0.0:1789760766.608623:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066505344:0@lo:400: 00000100:00100000:2.0:1789760766.608824:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760766.608834:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066505216:12345-0@lo:400: 00000100:00100000:2.0:1789760766.608885:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066505216:12345-0@lo:400: Request processed in 53us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.608892:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760766.608931:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066505088:0@lo:400: 00010000:00080000:2.0:1789760766.608961:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c04890a80 x1876700066505216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760766.608972:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066505216:0@lo:400: 00000020:00000080:0.0:1789760767.130415:0:8814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff661e3c10 20000000:00000080:0.0:1789760767.130433:0:8814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa09c3ecda800 uarg=0000000000000000 20000000:01000000:0.0:1789760767.130473:0:8814:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789760767.130475:0:8814:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789760767.130478:0:8814:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789760767.130482:0:8814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789760767.130488:0:8814:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789760767.130559:0:8814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789760767.130562:0:8814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789760767.133953:0:8815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789760767.134169:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789760767.134202:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789760767.134219:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789760767.134229:0:8814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789760767.134231:0:8814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789760767.136452:0:8816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789760767.136731:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789760767.136792:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789760767.136820:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789760767.136832:0:8814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789760767.136834:0:8814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789760767.137382:0:8817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789760767.137750:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789760767.137800:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789760767.137817:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789760767.137830:0:8814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789760767.137832:0:8814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789760767.138139:0:8818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789760767.138281:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789760767.138304:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789760767.138320:0:8814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1789760767.138333:0:8814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789760767.138356:0:8814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138382:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138390:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138397:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 18 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138404:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138411:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138418:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138424:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 18 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138432:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 9 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138438:0:8814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 9 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138445:0:8814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138491:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 9 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138557:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 9 pid: 5941 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.138571:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f219c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505472:192.168.203.13@tcp:104: 00010000:00010000:2.0:1789760767.138832:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 9 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138841:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 9 pid: 5940 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.138849:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505600:192.168.203.13@tcp:104: 00010000:00010000:2.0:1789760767.138882:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 18 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138889:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 18 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.138898:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f218e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505728:0@lo:104: 00000100:00100000:2.0:1789760767.138930:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760767.138986:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.138994:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 18 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139007:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066505728 00000100:00100000:0.0:1789760767.139014:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066505728 00000100:00100000:2.0:1789760767.139015:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505856:0@lo:104: 00000100:00100000:2.0:1789760767.139038:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760767.139303:0:5930:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789760767.139313:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066505856 00000100:00100000:0.0:1789760767.139316:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066505856 00010000:00010000:2.0:1789760767.139316:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.139325:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 18 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.139333:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505984:0@lo:104: 00000100:00100000:0.0:1789760767.139334:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760767.139343:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+4:8814:x1876700066505728:12345-0@lo:104: 00000100:00100000:2.0:1789760767.139353:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760767.139355:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.139368:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.139375:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 18 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.139383:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f219180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506112:0@lo:104: 00010000:00010000:0.0:1789760767.139397:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760767.139400:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760767.139403:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+4:8814:x1876700066505728:12345-0@lo:104: Request processed in 61us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760767.139409:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789760767.139413:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 18 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.139420:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 18 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139423:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066505984 00000100:00100000:2.0:1789760767.139428:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506240:0@lo:104: 00000100:00100000:0.0:1789760767.139431:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066505984 00000100:00100000:0.0:1789760767.139443:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506112 00000100:00100000:0.0:1789760767.139446:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506112 00000100:00100000:2.0:1789760767.139446:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760767.139454:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506240 00000100:00100000:0.0:1789760767.139456:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506240 00010000:00010000:2.0:1789760767.139461:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139465:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760767.139470:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ef41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+6:8814:x1876700066505856:12345-0@lo:104: 00010000:00010000:0.0:1789760767.139477:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.139479:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 18 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.139487:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506368:0@lo:104: 00000100:00100000:2.0:1789760767.139520:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760767.139521:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760767.139525:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ef41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+6:8814:x1876700066505856:12345-0@lo:104: Request processed in 55us (487us total) trans 0 rc 0/0 00010000:00010000:2.0:1789760767.139536:0:8814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.139544:0:8814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 18 pid: 5939 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.139552:0:8814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c04891180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506496:0@lo:104: 00000100:00100000:2.0:1789760767.139572:0:8814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760767.139582:0:8814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c05d1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789760767.139601:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f218e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505728:0@lo:104: 00000100:00100000:2.0:1789760767.139609:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505856:0@lo:104: 00000100:00100000:0.0:1789760767.139657:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760767.139696:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506368 00000100:00100000:0.0:1789760767.139699:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506368 00000100:00100000:0.0:1789760767.139710:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506496 00000100:00100000:0.0:1789760767.139712:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506496 00000100:00100000:0.0:1789760767.139722:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760767.139727:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f21b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+7:8814:x1876700066505984:12345-0@lo:104: 00010000:00010000:0.0:1789760767.139735:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.139753:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760767.139786:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789760767.139786:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139792:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f21b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+7:8814:x1876700066505984:12345-0@lo:104: Request processed in 64us (437us total) trans 0 rc 0/0 00010000:00010000:3.0:1789760767.139794:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f2800 already unused, calling callback (ffffffffc1283c20) 00000100:00100000:0.0:1789760767.139797:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:00010000:3.0:1789760767.139798:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139808:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760767.139814:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+6:8814:x1876700066506112:12345-0@lo:104: 00010000:00010000:3.0:1789760767.139817:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760767.139824:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.139826:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760767.139830:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760767.139852:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789760767.139856:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139857:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+6:8814:x1876700066506112:12345-0@lo:104: Request processed in 44us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760767.139863:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789760767.139863:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789760767.139875:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789760767.139880:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+5:8814:x1876700066506240:12345-0@lo:104: 00010000:00010000:3.0:1789760767.139881:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.139887:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.139888:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f2800/0x1287b6a7b7c528af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c528b6 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.139900:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789760767.139903:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.139909:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01546a00 already unused, calling callback (ffffffffc1283c20) 00010000:00010000:0.0:1789760767.139910:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:3.0:1789760767.139912:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139914:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+5:8814:x1876700066506240:12345-0@lo:104: Request processed in 35us (468us total) trans 0 rc 0/0 00010000:00010000:3.0:1789760767.139919:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139920:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:00010000:3.0:1789760767.139925:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.139929:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760767.139934:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+4:8814:x1876700066506368:12345-0@lo:104: 10000000:01000000:3.0:1789760767.139935:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760767.139940:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.139948:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.139953:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760767.139958:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.139960:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789760767.139964:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+4:8814:x1876700066506368:12345-0@lo:104: Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760767.139970:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760767.139993:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760767.139998:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:8814:x1876700066506496:12345-0@lo:104: 00010000:00010000:0.0:1789760767.140012:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.140039:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789760767.140044:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:8814:x1876700066506496:12345-0@lo:104: Request processed in 46us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760767.140050:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789760767.140066:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789760767.140329:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01546a00/0x1287b6a7b7c5288c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52893 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140339:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789760767.140343:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140349:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01680000 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:3.0:1789760767.140352:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140363:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760767.140369:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760767.140374:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760767.140391:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140396:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789760767.140404:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505984:0@lo:104: 00000100:00100000:2.0:1789760767.140412:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f219180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506112:0@lo:104: 00000100:00100000:2.0:1789760767.140419:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506240:0@lo:104: 00000100:00100000:2.0:1789760767.140429:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506368:0@lo:104: 00000100:00100000:2.0:1789760767.140437:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c04891180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066506496:0@lo:104: 00000100:00100000:0.0:1789760767.140450:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066506880:0@lo:103: 00000100:00100000:0.0:1789760767.140479:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760767.140560:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506880 00000100:00100000:1.0:1789760767.140570:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506880 00010000:00010000:1.0:1789760767.140590:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 19 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.140620:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760767.140628:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066506880:12345-0@lo:103: 00010000:00010000:1.0:1789760767.140638:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760767.140643:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 19 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.140652:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 19 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.140674:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01680600/0x1287b6a7b7c52869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52862 expref: 19 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.140687:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760767.140797:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140805:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01680000/0x1287b6a7b7c52862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52869 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140865:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789760767.140869:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140874:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01681000 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:3.0:1789760767.140877:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140882:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760767.140887:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760767.140892:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760767.140908:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140913:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760767.140928:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140935:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01681000/0x1287b6a7b7c52854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5285b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.140979:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760767.140988:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.141010:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066507008:0@lo:103: 00000100:00100000:2.0:1789760767.141050:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760767.141167:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01546000 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:3.0:1789760767.141170:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141177:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760767.141183:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760767.141188:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760767.141202:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141207:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760767.141211:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141217:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01546000/0x1287b6a7b7c5282a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52831 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141225:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760767.141228:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141233:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01547c00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:3.0:1789760767.141236:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141251:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760767.141256:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760767.141260:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760767.141269:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141274:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760767.141277:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141283:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01547c00/0x1287b6a7b7c52800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52807 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141290:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760767.141291:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760767.141292:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760767.141310:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066506624:0@lo:103: 00000100:00100000:3.0:1789760767.141335:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066506752:0@lo:103: 00000100:00100000:2.0:1789760767.141455:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507008 00000100:00100000:2.0:1789760767.141459:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507008 00010000:00010000:2.0:1789760767.141477:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 19 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.141568:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760767.141588:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066507264:0@lo:103: 00000100:00100000:3.0:1789760767.141627:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760767.141657:0:8012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506752 00000100:00100000:3.0:1789760767.141660:0:8012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506752 00010000:00010000:3.0:1789760767.141674:0:8012:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 20 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.141696:0:8012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507264 00000100:00100000:3.0:1789760767.141699:0:8012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507264 00010000:00010000:3.0:1789760767.141710:0:8012:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 21 pid: 5939 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.141722:0:8012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760767.141728:0:8012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:586668c1-4957-4570-b773-2405a941ae03+21:3440:x1876700066506752:12345-0@lo:103: 00010000:00010000:3.0:1789760767.141736:0:8012:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760767.141741:0:8012:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 21 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141749:0:8012:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 21 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141777:0:8012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01680a00/0x1287b6a7b7c52893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c5288c expref: 21 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141790:0:8012:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760767.141810:0:5934:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789760767.141816:0:8012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:586668c1-4957-4570-b773-2405a941ae03+20:3440:x1876700066506752:12345-0@lo:103: Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760767.141818:0:5934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1789760767.141822:0:8012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760767.141836:0:8012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760767.141842:0:8012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:586668c1-4957-4570-b773-2405a941ae03+19:3440:x1876700066507264:12345-0@lo:103: 00010000:00010000:3.0:1789760767.141848:0:8012:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760767.141853:0:8012:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 19 pid: 5939 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141860:0:8012:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 19 pid: 5939 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.141873:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760767.141876:0:8012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52800 expref: 19 pid: 5939 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.141879:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.141884:0:8012:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760767.141886:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01681c00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760767.141889:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.141895:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760767.141901:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.141904:0:8012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:586668c1-4957-4570-b773-2405a941ae03+18:3440:x1876700066507264:12345-0@lo:103: Request processed in 63us (277us total) trans 0 rc 0/0 10000000:01000000:0.0:1789760767.141907:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789760767.141910:0:8012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789760767.141925:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.141931:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760767.141941:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789760767.141949:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066507136:0@lo:103: 00010000:00010000:0.0:1789760767.141953:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.141959:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01681c00/0x1287b6a7b7c52870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52877 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.141985:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760767.141987:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760767.141988:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760767.141998:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760767.142006:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066507392:0@lo:103: 00000100:00100000:0.0:1789760767.142030:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760767.142047:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760767.142049:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760767.142105:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+17:3441:x1876700066506880:12345-0@lo:103: Request processed in 1478us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.142112:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760767.142127:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066506624 00000100:00100000:1.0:1789760767.142130:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066506624 00010000:00010000:1.0:1789760767.142140:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 17 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.142150:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507392 00000100:00100000:1.0:1789760767.142152:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507392 00010000:00010000:1.0:1789760767.142160:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 18 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.142169:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760767.142182:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+18:3439:x1876700066506624:12345-0@lo:103: 00010000:00010000:1.0:1789760767.142201:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760767.142205:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 18 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.142213:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 18 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.142223:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01547a00/0x1287b6a7b7c528b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c528af expref: 18 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.142230:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760767.142253:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+17:3439:x1876700066506624:12345-0@lo:103: Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.142258:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760767.142269:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760767.142274:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+16:3442:x1876700066507392:12345-0@lo:103: 00010000:00010000:1.0:1789760767.142280:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760767.142285:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 16 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.142292:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 16 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.142302:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01546200/0x1287b6a7b7c52877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52870 expref: 16 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.142311:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760767.142338:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+15:3442:x1876700066507392:12345-0@lo:103: Request processed in 64us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.142352:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760767.142382:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066507392:0@lo:103: 00000100:00100000:0.0:1789760767.142479:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066506880:0@lo:103: 00000100:00100000:2.0:1789760767.142541:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760767.142549:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+14:3442:x1876700066507008:12345-0@lo:103: 00010000:00010000:2.0:1789760767.142558:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760767.142562:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 14 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.142570:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 14 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.142580:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01680400/0x1287b6a7b7c5285b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52854 expref: 14 pid: 5940 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.142589:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760767.142625:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:586668c1-4957-4570-b773-2405a941ae03+13:3442:x1876700066507008:12345-0@lo:103: Request processed in 78us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760767.142631:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760767.142790:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066507008:0@lo:103: 00000100:00100000:2.0:1789760767.142907:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066506752:0@lo:103: 00000100:00100000:2.0:1789760767.142915:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066507264:0@lo:103: 00000100:00100000:3.0:1789760767.142939:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760767.144221:0:5934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507136 00000100:00100000:2.0:1789760767.144229:0:5934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507136 00010000:00010000:2.0:1789760767.144259:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 13 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.144267:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066506624:0@lo:103: 00000100:00100000:2.0:1789760767.144299:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760767.144309:0:5934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c20eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+13:3439:x1876700066507136:12345-0@lo:103: 00010000:00010000:2.0:1789760767.144321:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760767.144337:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 13 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.144348:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 13 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.144363:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c013f3000/0x1287b6a7b7c52831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c5282a expref: 13 pid: 5941 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.144376:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760767.144423:0:5934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c20eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:586668c1-4957-4570-b773-2405a941ae03+12:3439:x1876700066507136:12345-0@lo:103: Request processed in 116us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760767.144431:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760767.144450:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066507136:0@lo:103: 00000100:00100000:2.0:1789760767.144859:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505600:192.168.203.13@tcp:104: 00000100:00100000:2.0:1789760767.145544:0:8814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f219c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8814:1876700066505472:192.168.203.13@tcp:104: 00010000:00010000:2.0:1789760767.145593:0:8814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.146261:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760767.146297:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760767.146393:0:8012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658560 00000100:00100000:1.0:1789760767.146400:0:8012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658560 00010000:00010000:1.0:1789760767.146427:0:8012:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 10 pid: 5940 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.146457:0:8012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658688 00000100:00100000:1.0:1789760767.146460:0:8012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658688 00010000:00010000:1.0:1789760767.146470:0:8012:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 11 pid: 5941 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760767.146488:0:8012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1789760767.146496:0:8012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:2361:x1876700048658560:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1789760767.146508:0:8012:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760767.146514:0:8012:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 11 pid: 5940 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146523:0:8012:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 11 pid: 5940 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146538:0:8012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c35325200/0x1287b6a7b7c528cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561ae expref: 11 pid: 5940 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146550:0:8012:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760767.146590:0:8012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048658560:12345-192.168.203.13@tcp:103: Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.146611:0:8012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1789760767.146627:0:8012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1789760767.146634:0:8012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:2361:x1876700048658688:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1789760767.146641:0:8012:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760767.146646:0:8012:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 9 pid: 5941 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146656:0:8012:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 9 pid: 5941 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146677:0:8012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c11feec00/0x1287b6a7b7c528d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561b5 expref: 9 pid: 5941 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146689:0:8012:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146696:0:8012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146711:0:8012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146719:0:8012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146726:0:8012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146733:0:8012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146745:0:8012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c11e45e00 already unused, calling callback (ffffffffc0c66350) 00010000:00010000:1.0:1789760767.146749:0:8012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146758:0:8012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146794:0:8012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760767.146803:0:8012:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760767.146824:0:8012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:2361:x1876700048658688:12345-192.168.203.13@tcp:103: Request processed in 190us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.146830:0:8012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:2.0:1789760767.146996:0:8814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.147006:0:8814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.147018:0:8814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c11e45e00/0x1287b6a7b7c5290a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.243431:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760767.625754:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760767.625796:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066507520:0@lo:13: 00000100:00100000:2.0:1789760767.625872:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760767.626130:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507520 00000100:00100000:3.0:1789760767.626137:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507520 00000100:00100000:3.0:1789760767.626204:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760767.626214:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066507520:12345-0@lo:13: 00002000:00000024:3.0:1789760767.626246:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760767.626303:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066507520:12345-0@lo:13: Request processed in 89us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760767.626311:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789760767.627592:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede2d80 x1876700066507520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760767.627616:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066507520:0@lo:13: 00010000:00010000:0.0:1789760768.264952:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789760768.520876:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760768.520884:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c08945800 from 39 10000000:01000000:3.0:1789760768.520890:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760768.520946:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.520957:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.520979:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.521000:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066507648:0@lo:101: 00000100:00100000:3.0:1789760768.521063:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.521234:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.521308:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507648 00000100:00100000:0.0:1789760768.521317:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507648 00000100:00100000:0.0:1789760768.521374:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789760768.521383:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+12:5944:x1876700066507648:12345-0@lo:101: 00010000:00010000:0.0:1789760768.521396:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760768.521409:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52911 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.521432:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52911 expref: 13 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.521455:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35325a00/0x1287b6a7b7c52918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52911 expref: 13 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.521465:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35325a00, rc 0) 00000100:00100000:0.0:1789760768.521517:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066507648:12345-0@lo:101: Request processed in 135us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.521524:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789760768.522078:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066507648:0@lo:101: 00010000:00010000:3.0:1789760768.522094:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52918 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.522102:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52918 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.522163:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066507776:0@lo:501: 00000100:00100000:3.0:1789760768.522194:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.522262:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507776 00000100:00100000:0.0:1789760768.522267:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507776 00000100:00100000:0.0:1789760768.522300:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789760768.522308:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066507776:12345-0@lo:501: 00000100:00100000:0.0:1789760768.522423:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066507776:12345-0@lo:501: Request processed in 115us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.522430:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789760768.526204:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.526250:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066507776:0@lo:501: 00000100:00100000:3.0:1789760768.526313:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066507904:0@lo:503: 00000100:00100000:3.0:1789760768.526388:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.526480:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.527904:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760768.530743:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066507904 00000100:00100000:1.0:1789760768.530980:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066507904 00000100:00100000:1.0:1789760768.533014:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658816 00000100:00100000:1.0:1789760768.533027:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658816 00000100:00100000:1.0:1789760768.533070:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760768.533079:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066507904:12345-0@lo:503: 00000100:00100000:1.0:1789760768.533265:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066507904:12345-0@lo:503: Request processed in 186us (6876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.533273:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760768.533313:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:1.0:1789760768.533328:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+8:5445:x1876700048658816:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1789760768.533337:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760768.533355:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c013f3c00/0x1287b6a7b7c5291f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c56217 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.533378:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c013f3c00/0x1287b6a7b7c5291f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56217 expref: 9 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.533390:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c013f3c00/0x1287b6a7b7c5291f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56217 expref: 9 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.537858:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066507904:0@lo:503: 00010000:00010000:1.0:1789760768.538052:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c013f3c00, rc 0) 00000100:00100000:1.0:1789760768.538113:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048658816:12345-192.168.203.13@tcp:101: Request processed in 4785us (10215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.538121:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:3.0:1789760768.539306:0:8833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8833:1876700066508032:0@lo:502: 00000100:00100000:3.0:1789760768.539378:0:8833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.539428:0:8833:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760768.539551:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508032 00000100:00100000:2.0:1789760768.539557:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508032 00000100:00100000:2.0:1789760768.539613:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789760768.539623:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8833:x1876700066508032:12345-0@lo:502: 00000100:00100000:2.0:1789760768.539751:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+13:8833:x1876700066508032:12345-0@lo:502: Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.539779:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789760768.540045:0:8833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8833:1876700066508032:0@lo:502: 00000100:00100000:3.0:1789760768.540097:0:8833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8833:1876700066508160:0@lo:502: 00000100:00100000:3.0:1789760768.540132:0:8833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.540164:0:8833:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.540347:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508160 00000100:00100000:0.0:1789760768.540352:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508160 00000100:00100000:0.0:1789760768.540389:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789760768.540408:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:8833:x1876700066508160:12345-0@lo:502: 00000100:00100000:0.0:1789760768.540505:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:8833:x1876700066508160:12345-0@lo:502: Request processed in 98us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.540513:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789760768.540903:0:8833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8833:1876700066508160:0@lo:502: 00000040:00080000:3.0:1789760768.540928:0:8833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789760768.541258:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789760768.541283:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760768.541293:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52918 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.541304:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c11fef600/0x1287b6a7b7c52911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52918 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760768.541321:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789760768.541323:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789760768.541326:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789760768.541350:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.541358:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.541367:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.541380:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508288:0@lo:101: 00000100:00100000:0.0:1789760768.541477:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.541508:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760768.541561:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508288 00000100:00100000:2.0:1789760768.541566:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508288 00000100:00100000:2.0:1789760768.541698:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760768.541708:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+13:5944:x1876700066508288:12345-0@lo:101: 00010000:00010000:2.0:1789760768.541718:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760768.541730:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11e45800/0x1287b6a7b7c5292d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52926 expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.541750:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11e45800/0x1287b6a7b7c5292d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52926 expref: 14 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.541793:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11e45800/0x1287b6a7b7c5292d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52926 expref: 14 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.541803:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11e45800, rc 0) 00000100:00100000:2.0:1789760768.541840:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066508288:12345-0@lo:101: Request processed in 134us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.541882:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508288:0@lo:101: 00010000:00010000:0.0:1789760768.541894:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5292d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.541903:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5292d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.541947:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508416:0@lo:501: 00000100:00100000:0.0:1789760768.541981:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.542000:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.542229:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760768.542242:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508416 00000100:00100000:3.0:1789760768.542245:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508416 00000100:00100000:1.0:1789760768.542447:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048658944 00000100:00100000:1.0:1789760768.542452:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048658944 00000100:00100000:1.0:1789760768.542472:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:1.0:1789760768.542479:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048658944:12345-192.168.203.13@tcp:501: 00000100:00100000:1.0:1789760768.542710:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048658944:12345-192.168.203.13@tcp:501: Request processed in 230us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.542717:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:2.0:1789760768.542835:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789760768.543031:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760768.543039:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066508416:12345-0@lo:501: 00000100:00100000:3.0:1789760768.543118:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066508416:12345-0@lo:501: Request processed in 81us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.543125:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789760768.543197:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508416:0@lo:501: 00000100:00100000:2.0:1789760768.543234:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508544:0@lo:503: 00000100:00100000:2.0:1789760768.543274:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.543305:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c05d1d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.543456:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508544 00000100:00100000:1.0:1789760768.543461:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508544 00000100:00100000:1.0:1789760768.543490:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789760768.543496:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066508544:12345-0@lo:503: 00000100:00100000:1.0:1789760768.543566:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066508544:12345-0@lo:503: Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.543577:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760768.543745:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508544:0@lo:503: 00000100:00100000:2.0:1789760768.544078:0:8834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8834:1876700066508672:0@lo:502: 00000100:00100000:2.0:1789760768.544112:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.544139:0:8834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c05d1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.544258:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508672 00000100:00100000:1.0:1789760768.544263:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508672 00000100:00100000:1.0:1789760768.544295:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789760768.544302:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8834:x1876700066508672:12345-0@lo:502: 00000100:00100000:1.0:1789760768.544464:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:8834:x1876700066508672:12345-0@lo:502: Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.544473:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789760768.544577:0:8834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8834:1876700066508672:0@lo:502: 00000020:01000000:2.0:1789760768.544752:0:8834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760768.544787:0:8834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760768.544789:0:8834:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789760768.544795:0:8834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789760768.544819:0:8834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8834:1876700066508800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760768.544853:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.544871:0:8834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c05d1d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.544941:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508800 00000100:00100000:3.0:1789760768.544946:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508800 00000100:00100000:3.0:1789760768.544981:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789760768.544989:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8834:x1876700066508800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760768.546892:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+14:8834:x1876700066508800:12345-0@lo:502:llog_process_th.0 Request processed in 1896us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.546905:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789760768.548503:0:8834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8834:1876700066508800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760768.548553:0:8834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760768.548563:0:8834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760768.548566:0:8834:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789760768.548570:0:8834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789760768.548743:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789760768.548803:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789760768.548815:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5292d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.548826:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c35325800/0x1287b6a7b7c52926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5292d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760768.548836:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760768.548839:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c05703000 from 39 10000000:01000000:3.0:1789760768.548842:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760768.548875:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.548883:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.548893:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.548913:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760768.548982:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.549013:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.549080:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066508928 00000100:00100000:1.0:1789760768.549088:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066508928 00000100:00100000:1.0:1789760768.549136:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760768.549146:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+14:5944:x1876700066508928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760768.549157:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760768.549170:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c013f2400/0x1287b6a7b7c5293b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52934 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.549203:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c013f2400/0x1287b6a7b7c5293b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52934 expref: 15 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.549213:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c013f2400/0x1287b6a7b7c5293b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52934 expref: 15 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.549221:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c013f2400, rc 0) 00000100:00100000:1.0:1789760768.549260:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066508928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.549266:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789760768.550649:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066508928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760768.550672:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5293b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.550683:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5293b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.550759:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760768.560516:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760768.560538:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.560588:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.560599:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659072 00000100:00100000:0.0:1789760768.560608:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659072 00000100:00100000:0.0:1789760768.560654:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509056 00000100:00100000:0.0:1789760768.560664:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509056 00000100:00100000:0.0:1789760768.560686:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:0.0:1789760768.560695:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048659072:12345-192.168.203.13@tcp:503: 00000100:00100000:0.0:1789760768.560838:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048659072:12345-192.168.203.13@tcp:503: Request processed in 142us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.560846:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:0.0:1789760768.560872:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789760768.560879:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066509056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.560992:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066509056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.560999:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789760768.561207:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760768.561251:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760768.561341:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.561375:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760768.561389:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509184 00000100:00100000:2.0:1789760768.561407:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509184 00000100:00100000:2.0:1789760768.561473:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789760768.561481:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066509184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760768.561564:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066509184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.561572:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789760768.562006:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760768.562237:0:8835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8835:1876700066509312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760768.562276:0:8835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.571124:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509312 00000100:00100000:1.0:1789760768.571151:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509312 00000100:00100000:1.0:1789760768.571200:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789760768.571209:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:8835:x1876700066509312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760768.571369:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:8835:x1876700066509312:12345-0@lo:502:llog_process_th.0 Request processed in 160us (9092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.571374:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789760768.571573:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760768.571587:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659200 00000100:00100000:1.0:1789760768.571590:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659200 00000100:00100000:1.0:1789760768.571602:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:1.0:1789760768.571606:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5917:x1876700048659200:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1789760768.571659:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5917:x1876700048659200:12345-192.168.203.13@tcp:502: Request processed in 52us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.571664:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1789760768.571938:0:8835:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.571972:0:8835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8835:1876700066509312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760768.572030:0:8835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8835:1876700066509440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760768.572059:0:8835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.572077:0:8835:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.572099:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509440 00000100:00100000:1.0:1789760768.572103:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509440 00000100:00100000:1.0:1789760768.572121:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789760768.572127:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:8835:x1876700066509440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760768.572202:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:8835:x1876700066509440:12345-0@lo:502:llog_process_th.0 Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.572209:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789760768.572269:0:8835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8835:1876700066509440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789760768.572293:0:8835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789760768.572525:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789760768.572546:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760768.572556:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5293b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.572567:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c11fefa00/0x1287b6a7b7c52934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5293b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760768.572584:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789760768.572586:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789760768.572589:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760768.572610:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.572623:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.572633:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.572646:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.572674:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.573093:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.573122:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509568 00000100:00100000:3.0:1789760768.573126:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509568 00000100:00100000:3.0:1789760768.573147:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789760768.573152:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+15:5944:x1876700066509568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760768.573160:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760768.573171:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11fefc00/0x1287b6a7b7c52949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52942 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.573208:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11fefc00/0x1287b6a7b7c52949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52942 expref: 16 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.573219:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11fefc00/0x1287b6a7b7c52949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52942 expref: 16 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.573227:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11fefc00, rc 0) 00000100:00100000:3.0:1789760768.573276:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066509568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.573306:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760768.573322:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52949 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.573331:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52949 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.573352:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760768.573381:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.573404:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.573452:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760768.573485:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509696 00000100:00100000:2.0:1789760768.573495:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509696 00000100:00100000:2.0:1789760768.573520:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789760768.573527:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066509696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760768.573622:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066509696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.573629:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760768.573649:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.573673:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.573982:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.574000:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.574161:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509824 00000100:00100000:3.0:1789760768.574167:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509824 00000100:00100000:3.0:1789760768.574201:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789760768.574209:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066509824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760768.574299:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066509824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.574306:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760768.574331:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066509824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760768.574578:0:8836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8836:1876700066509952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760768.574605:0:8836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.574653:0:8836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c05d1d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.574678:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066509952 00000100:00100000:3.0:1789760768.574682:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066509952 00000100:00100000:3.0:1789760768.574732:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789760768.574739:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:8836:x1876700066509952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760768.574958:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:8836:x1876700066509952:12345-0@lo:502:llog_process_th.0 Request processed in 218us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.574976:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789760768.575091:0:8836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8836:1876700066509952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760768.575113:0:8836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760768.575122:0:8836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760768.575124:0:8836:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789760768.575129:0:8836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789760768.575150:0:8836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8836:1876700066510080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760768.575185:0:8836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.575219:0:8836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c02cdee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.575263:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510080 00000100:00100000:1.0:1789760768.575268:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510080 00000100:00100000:1.0:1789760768.575286:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789760768.575293:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:8836:x1876700066510080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760768.575369:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+16:8836:x1876700066510080:12345-0@lo:502:llog_process_th.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.575375:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789760768.575442:0:8836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8836:1876700066510080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760768.575460:0:8836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760768.575465:0:8836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760768.575466:0:8836:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789760768.575470:0:8836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789760768.575705:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789760768.575725:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789760768.575735:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52949 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.575745:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f3600/0x1287b6a7b7c52942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52949 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760768.575756:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760768.575889:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09c1126a000 from 39 10000000:01000000:1.0:1789760768.575892:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760768.575922:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.575930:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.575938:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.575969:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.575998:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.576051:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f1c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.576085:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510208 00000100:00100000:3.0:1789760768.576089:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510208 00000100:00100000:3.0:1789760768.576361:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760768.576463:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659328 00000100:00100000:2.0:1789760768.576468:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659328 00000100:00100000:2.0:1789760768.576487:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789760768.576493:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066510208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760768.576503:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760768.576522:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11e45c00/0x1287b6a7b7c52957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52950 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.576544:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11e45c00/0x1287b6a7b7c52957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52950 expref: 17 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.576554:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11e45c00/0x1287b6a7b7c52957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52950 expref: 17 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.576563:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11e45c00, rc 0) 00000100:00100000:2.0:1789760768.576600:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066510208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.576605:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789760768.576625:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:2.0:1789760768.576631:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5917:x1876700048659328:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789760768.576715:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5917:x1876700048659328:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 82us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.576722:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1789760768.576809:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760768.576821:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52957 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.576831:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52957 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.576884:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.576939:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.576991:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.577043:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510336 00000100:00100000:1.0:1789760768.577047:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510336 00000100:00100000:1.0:1789760768.577097:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789760768.577112:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066510336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.577279:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066510336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.577286:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789760768.577478:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.577507:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.577544:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.577563:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.577607:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510464 00000100:00100000:1.0:1789760768.577611:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510464 00000100:00100000:1.0:1789760768.577628:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789760768.577634:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066510464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.577746:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066510464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.577753:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789760768.577900:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.578249:0:8837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8837:1876700066510592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760768.578283:0:8837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.578301:0:8837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c1136d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760768.578347:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510592 00000100:00100000:1.0:1789760768.578352:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510592 00000100:00100000:1.0:1789760768.578379:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789760768.578385:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:8837:x1876700066510592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760768.578501:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:8837:x1876700066510592:12345-0@lo:502:llog_process_th.0 Request processed in 115us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.578509:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789760768.578566:0:8837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8837:1876700066510592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760768.578605:0:8837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8837:1876700066510720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760768.578643:0:8837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.578664:0:8837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c02cdee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760768.578723:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510720 00000100:00100000:2.0:1789760768.578727:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510720 00000100:00100000:2.0:1789760768.578889:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789760768.578898:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:8837:x1876700066510720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760768.578977:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:8837:x1876700066510720:12345-0@lo:502:llog_process_th.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.579049:0:8837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8837:1876700066510720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789760768.579068:0:8837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1789760768.579225:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000020:01000000:1.0:1789760768.579273:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789760768.579299:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760768.579309:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52957 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.579319:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f3e00/0x1287b6a7b7c52950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52957 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760768.579329:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789760768.579332:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789760768.579335:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760768.579359:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.579368:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.579377:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.579392:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.579422:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.579478:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.579513:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510848 00000100:00100000:0.0:1789760768.579518:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510848 00000100:00100000:0.0:1789760768.579578:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789760768.579585:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066510848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760768.579594:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760768.579605:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5295e expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.579624:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5295e expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.579635:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35325c00/0x1287b6a7b7c52965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5295e expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.579644:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35325c00, rc 0) 00000100:00100000:0.0:1789760768.579715:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066510848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.579722:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789760768.579933:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760768.579946:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52965 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.579955:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52965 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.580013:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.580046:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.580093:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.580160:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066510976 00000100:00100000:0.0:1789760768.580165:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066510976 00000100:00100000:0.0:1789760768.580213:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789760768.580219:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066510976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.580321:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066510976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.580334:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789760768.580402:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066510976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.580427:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066511104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.580459:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.580507:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066511104 00000100:00100000:2.0:1789760768.580511:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066511104 00000100:00100000:1.0:1789760768.580516:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760768.580536:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789760768.580542:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066511104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760768.580612:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066511104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.580618:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789760768.580637:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066511104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760768.581143:0:8838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8838:1876700066511232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760768.581176:0:8838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.581230:0:8838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83300 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.581265:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066511232 00000100:00100000:0.0:1789760768.581269:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066511232 00000100:00100000:0.0:1789760768.581299:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789760768.581306:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:8838:x1876700066511232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760768.581461:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:8838:x1876700066511232:12345-0@lo:502:llog_process_th.0 Request processed in 155us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.581468:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789760768.581526:0:8838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8838:1876700066511232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760768.581550:0:8838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760768.581558:0:8838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760768.581561:0:8838:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789760768.581567:0:8838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789760768.581587:0:8838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8838:1876700066511360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760768.581616:0:8838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760768.581669:0:8838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.581970:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066511360 00000100:00100000:3.0:1789760768.581979:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066511360 00000100:00100000:2.0:1789760768.582045:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789760768.582052:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:8838:x1876700066511360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760768.582133:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:8838:x1876700066511360:12345-0@lo:502:llog_process_th.0 Request processed in 80us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.582139:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789760768.582205:0:8838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8838:1876700066511360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760768.582225:0:8838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760768.582229:0:8838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760768.582230:0:8838:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789760768.582234:0:8838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:2.0:1789760768.582831:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760768.582907:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659456 00000100:00100000:1.0:1789760768.582911:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659456 00000100:00100000:1.0:1789760768.582956:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:1.0:1789760768.582975:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048659456:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760768.582985:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760768.583001:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c013f2800/0x1287b6a7b7c5296c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c5621e expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.583026:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c013f2800/0x1287b6a7b7c5296c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c5621e expref: 10 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.583038:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c013f2800/0x1287b6a7b7c5296c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c5621e expref: 10 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.583046:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c013f2800, rc 0) 00000100:00100000:1.0:1789760768.583093:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048659456:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760768.583099:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000020:01000000:0.0:1789760768.583439:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789760768.583465:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789760768.583475:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52965 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.583484:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f3000/0x1287b6a7b7c5295e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52965 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760768.583493:0:5944:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789760768.583495:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa09c11ff0000 from 1 10000000:01000000:0.0:1789760768.583498:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789760768.583577:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.583586:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.583595:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.583614:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066511488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.583657:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760768.583722:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c17eab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760768.583981:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066511488 00000100:00100000:3.0:1789760768.583987:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066511488 00000100:00100000:0.0:1789760768.584066:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789760768.584073:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066511488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760768.584082:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760768.584091:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35324c00/0x1287b6a7b7c5297a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c52973 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.584110:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35324c00/0x1287b6a7b7c5297a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c52973 expref: 19 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.584119:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35324c00/0x1287b6a7b7c5297a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52973 expref: 19 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760768.584127:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35324c00, rc 0) 00000100:00100000:0.0:1789760768.584169:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066511488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760768.584175:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789760768.584243:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066511488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760768.584256:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5297a expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.584264:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c5297a expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.584318:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066511616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760768.584343:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.584372:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f360e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760768.584410:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066511616 00000100:00100000:0.0:1789760768.584414:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066511616 00000100:00100000:0.0:1789760768.584443:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789760768.584449:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066511616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760768.584514:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066511616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (169us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760768.584532:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789760768.584642:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066511616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789760768.584665:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760768.584670:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5297a expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.584692:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c35324a00/0x1287b6a7b7c52973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c5297a expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760768.586014:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760768.586079:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659584 00000100:00100000:2.0:1789760768.586085:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659584 00000100:00100000:2.0:1789760768.586129:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1789760768.586137:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048659584:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760768.586235:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048659584:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 97us (227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760768.586242:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00010000:00010000:0.0:1789760769.289057:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789760770.051750:0:8875:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5a549820 20000000:00000080:2.0:1789760770.051784:0:8875:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa09c3ee1c800 uarg=0000000000000000 20000000:01000000:2.0:1789760770.051821:0:8875:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789760770.051827:0:8875:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789760770.051831:0:8875:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789760770.052456:0:8876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789760770.052609:0:8875:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789760770.058265:0:8875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789760770.058376:0:8875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789760770.058409:0:8875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789760770.058424:0:8875:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789760770.058442:0:8875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058460:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058468:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058475:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058483:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 9 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058491:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058601:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 9 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058618:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 9 pid: 5941 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.058632:0:8875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066511744:192.168.203.13@tcp:104: 00010000:00010000:2.0:1789760770.058844:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058853:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 18 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.058870:0:8875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066511872:0@lo:104: 00000100:00100000:2.0:1789760770.058908:0:8875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760770.058939:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 18 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.058947:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 18 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.058966:0:8875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eced180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066512000:0@lo:104: 00000100:00100000:1.0:1789760770.060339:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066511872 00000100:00100000:1.0:1789760770.060352:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066511872 00000100:00100000:1.0:1789760770.060410:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760770.060421:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:8875:x1876700066511872:12345-0@lo:104: 00010000:00010000:1.0:1789760770.060436:0:5930:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.060516:0:5930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760770.060522:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:586668c1-4957-4570-b773-2405a941ae03+3:8875:x1876700066511872:12345-0@lo:104: Request processed in 104us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.060530:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760770.060689:0:8875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760770.060738:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.060749:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 18 pid: 5941 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.060777:0:8875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066512128:0@lo:104: 00000100:00100000:2.0:1789760770.060799:0:8875:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c05d1dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760770.060816:0:8875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066511872:0@lo:104: 00000100:00100000:1.0:1789760770.061102:0:8011:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789760770.061128:0:8011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.061149:0:8011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512000 00000100:00100000:1.0:1789760770.061153:0:8011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512000 00000100:00100000:1.0:1789760770.061174:0:8011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512128 00000100:00100000:1.0:1789760770.061177:0:8011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512128 00000100:00100000:1.0:1789760770.061187:0:8011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760770.061193:0:8011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:586668c1-4957-4570-b773-2405a941ae03+4:8875:x1876700066512000:12345-0@lo:104: 00010000:00010000:1.0:1789760770.061201:0:8011:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.061234:0:8011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789760770.061239:0:8011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:586668c1-4957-4570-b773-2405a941ae03+4:8875:x1876700066512000:12345-0@lo:104: Request processed in 47us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.061245:0:8011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760770.061284:0:8011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760770.061291:0:8011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:586668c1-4957-4570-b773-2405a941ae03+3:8875:x1876700066512128:12345-0@lo:104: 00010000:00010000:1.0:1789760770.061298:0:8011:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.061325:0:8011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789760770.061330:0:8011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:586668c1-4957-4570-b773-2405a941ae03+3:8875:x1876700066512128:12345-0@lo:104: Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.061335:0:8011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789760770.061404:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789760770.061411:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061418:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c01547e00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760770.061423:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061431:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760770.061437:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760770.061443:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789760770.061477:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061484:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760770.061504:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061521:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c01547e00/0x1287b6a7b7c5281c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c52823 expref: -99 pid: 8001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061533:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760770.061536:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061543:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f2c00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760770.061552:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061558:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760770.061564:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760770.061568:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789760770.061581:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061586:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760770.061593:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061599:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c527c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c527c8 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061608:0:5935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760770.061611:0:5935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061617:0:5935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c013f2a00 already unused, calling callback (ffffffffc1283c20) 10000000:00010000:0.0:1789760770.061620:0:5935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061625:0:5935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760770.061641:0:5935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760770.061645:0:5935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789760770.061659:0:5935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061664:0:5935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760770.061679:0:5935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061685:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffffa09c013f2a00/0x1287b6a7b7c52743 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1287b6a7b7c5274a expref: -99 pid: 6924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.061696:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760770.061698:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760770.061700:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760770.061706:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760770.061717:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066512384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760770.061748:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760770.061789:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760770.061795:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066512256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760770.061816:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760770.061840:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066512512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760770.061860:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760770.061889:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512384 00000100:00100000:0.0:1789760770.061892:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512384 00010000:00010000:0.0:1789760770.061912:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 19 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.061960:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512256 00000100:00100000:0.0:1789760770.061964:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512256 00000100:00100000:1.0:1789760770.062172:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512512 00000100:00100000:1.0:1789760770.062176:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512512 00010000:00010000:1.0:1789760770.062190:0:8820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 21 pid: 5941 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.062216:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760770.062223:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:586668c1-4957-4570-b773-2405a941ae03+21:3440:x1876700066512384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760770.062240:0:8820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760770.062246:0:8820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 21 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.062256:0:8820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 21 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.062271:0:8820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760770.062301:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:586668c1-4957-4570-b773-2405a941ae03+21:3440:x1876700066512384:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.062307:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760770.062320:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760770.062326:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:586668c1-4957-4570-b773-2405a941ae03+20:3441:x1876700066512512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760770.062332:0:8820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760770.062336:0:8820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 20 pid: 5941 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.062343:0:8820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 20 pid: 5941 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.062351:0:8820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760770.062372:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:586668c1-4957-4570-b773-2405a941ae03+20:3441:x1876700066512512:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.062377:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789760770.062428:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 19 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.062451:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760770.062458:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+19:3440:x1876700066512256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760770.062464:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760770.062468:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 19 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.062475:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 19 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.062485:0:5932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c013f2200/0x1287b6a7b7c52823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c5281c expref: 19 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.062494:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760770.062644:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:586668c1-4957-4570-b773-2405a941ae03+18:3440:x1876700066512256:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.062651:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760770.062688:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066512512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760770.062717:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066512256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760770.062724:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:586668c1-4957-4570-b773-2405a941ae03:3440:1876700066512384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760770.062803:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760770.063836:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c01681600/0x1287b6a7b7c527c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c527c1 expref: 17 pid: 5939 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.063852:0:8875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eced180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066512000:0@lo:104: 00010000:00010000:2.0:1789760770.063863:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c35325600/0x1287b6a7b7c5274a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1287b6a7b7c52743 expref: 16 pid: 5941 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.063871:0:8875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066512128:0@lo:104: 00000100:00100000:0.0:1789760770.066535:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760770.066714:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659840 00000100:00100000:3.0:1789760770.066723:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659840 00000100:00100000:3.0:1789760770.066816:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1789760770.066826:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2360:x1876700048659840:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760770.066892:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2360:x1876700048659840:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.066899:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00080000:0.0:1789760770.067098:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760770.074888:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760770.074929:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760770.074946:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660096 00000100:00100000:2.0:1789760770.074966:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660096 00000100:00100000:3.0:1789760770.074968:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00080000:0.0:1789760770.075051:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760770.075106:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659712 00000100:00100000:1.0:1789760770.075112:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659712 00000100:00100000:1.0:1789760770.075148:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:1.0:1789760770.075158:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2359:x1876700048659712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760770.075191:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760770.075209:0:5932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660224 00000100:00100000:3.0:1789760770.075213:0:5932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660224 00010000:00010000:3.0:1789760770.075233:0:5932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 11 pid: 5941 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.075239:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:2359:x1876700048659712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.075247:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1789760770.075258:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1789760770.075264:0:5932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f229880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048660224:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760770.075288:0:5932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760770.075294:0:5932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 10 pid: 5941 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075306:0:5932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 10 pid: 5941 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075333:0:5932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075341:0:5932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075356:0:5932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075363:0:5932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075370:0:5932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075377:0:5932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075383:0:5932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09c11e45400 already unused, calling callback (ffffffffc0c66350) 00010000:00010000:3.0:1789760770.075387:0:5932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075395:0:5932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075404:0:5932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.075415:0:5932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760770.075437:0:5932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f229880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048660224:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 172us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.075453:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1789760770.076974:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048659968 00000100:00100000:3.0:1789760770.077087:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1789760770.077104:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2360:x1876700048660096:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760770.077184:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2360:x1876700048660096:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.077191:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1789760770.077342:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048659968 00000100:00100000:0.0:1789760770.077470:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1789760770.077480:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2359:x1876700048659968:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760770.077518:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2359:x1876700048659968:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.077525:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:1.0:1789760770.077530:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760770.077841:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c528e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c561e6 expref: 9 pid: 5941 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.077861:0:8875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8875:1876700066511744:192.168.203.13@tcp:104: 00010000:00010000:3.0:1789760770.077891:0:8875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.077900:0:8875:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.077906:0:8875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.077911:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09c11e45400/0x1287b6a7b7c52981 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.085016:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760770.085145:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660352 00000100:00100000:3.0:1789760770.085155:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660352 00000100:00100000:3.0:1789760770.085212:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:3.0:1789760770.085223:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+9:5445:x1876700048660352:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760770.085241:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760770.085273:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11fefe00/0x1287b6a7b7c52988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c56225 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.085306:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11fefe00/0x1287b6a7b7c52988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56225 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.085319:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11fefe00/0x1287b6a7b7c52988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56225 expref: 10 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.085329:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11fefe00, rc 0) 00000100:00100000:3.0:1789760770.085791:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048660352:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 568us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.085799:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:3.0:1789760770.093336:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760770.093560:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660480 00000100:00100000:2.0:1789760770.093570:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660480 00000100:00100000:2.0:1789760770.093625:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1789760770.093635:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048660480:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760770.093800:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048660480:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 165us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.093808:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1789760770.102680:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760770.104096:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660608 00000100:00100000:0.0:1789760770.104109:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660608 00000100:00100000:0.0:1789760770.104160:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:0.0:1789760770.104179:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048660608:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760770.104321:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5445:x1876700048660608:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 152us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.104329:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:3.0:1789760770.112412:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760770.112738:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660736 00000100:00100000:1.0:1789760770.112748:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660736 00000100:00100000:1.0:1789760770.112822:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1789760770.112834:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5936:x1876700048660736:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789760770.113001:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5936:x1876700048660736:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 168us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760770.113008:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1789760770.115099:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760770.115899:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660864 00000100:00100000:2.0:1789760770.115988:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660864 00000100:00100000:2.0:1789760770.116047:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:2.0:1789760770.116058:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5936:x1876700048660864:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789760770.116222:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:5936:x1876700048660864:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 165us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.116229:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00010000:00010000:0.0:1789760770.312927:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760770.313022:0:5944:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760770.313027:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c08945800 from 4 10000000:01000000:1.0:1789760770.313032:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760770.313078:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.313091:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.313103:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.313128:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066512640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760770.313196:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.313374:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512640 00000100:00100000:3.0:1789760770.313382:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512640 00000100:00100000:3.0:1789760770.313435:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789760770.313444:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+16:5944:x1876700066512640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760770.313457:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760770.313471:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c52996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5298f expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.313493:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c52996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5298f expref: 17 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.313503:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11feea00/0x1287b6a7b7c52996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5298f expref: 17 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.313512:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11feea00, rc 0) 00000100:00100000:3.0:1789760770.313561:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066512640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.313567:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760770.313638:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760770.313662:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066512640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760770.313682:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52996 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.313692:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c52996 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.313747:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066512768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760770.313805:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.313958:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512768 00000100:00100000:3.0:1789760770.313963:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512768 00000100:00100000:3.0:1789760770.313997:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789760770.314004:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066512768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.314105:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066512768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.314112:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789760770.315740:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760770.315793:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066512768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760770.315848:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066512896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760770.315915:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.316008:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760770.317960:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066512896 00000100:00100000:3.0:1789760770.317973:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066512896 00000100:00100000:3.0:1789760770.318086:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789760770.318097:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066512896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.318267:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066512896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.318275:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789760770.318385:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066512896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760770.318981:0:8888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8888:1876700066513024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760770.319028:0:8888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.323467:0:8888:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83900 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.323628:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513024 00000100:00100000:0.0:1789760770.323637:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513024 00000100:00100000:0.0:1789760770.323684:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789760770.323693:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:8888:x1876700066513024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760770.323867:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:8888:x1876700066513024:12345-0@lo:502:llog_process_th.0 Request processed in 174us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.323874:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789760770.325917:0:8888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8888:1876700066513024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760770.326092:0:8888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760770.326106:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760770.326109:0:8888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789760770.326116:0:8888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09c08945800 00000020:00000080:1.0:1789760770.326119:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789760770.326284:0:8888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8888:1876700066513152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760770.326358:0:8888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.326412:0:8888:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760770.326477:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513152 00000100:00100000:3.0:1789760770.326484:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513152 00000100:00100000:3.0:1789760770.326572:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789760770.326581:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:8888:x1876700066513152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760770.326695:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+17:8888:x1876700066513152:12345-0@lo:502:llog_process_th.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.326703:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789760770.326796:0:8888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8888:1876700066513152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760770.326817:0:8888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760770.326822:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760770.326824:0:8888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789760770.326828:0:8888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789760770.328057:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789760770.328088:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789760770.328100:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52996 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.328120:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c013f2c00/0x1287b6a7b7c5298f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c52996 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760770.328131:0:5944:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789760770.328134:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c05703000 from 4 10000000:01000000:3.0:1789760770.328137:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760770.328243:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.328251:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.328262:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.328283:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.328341:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.328376:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f436240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760770.328395:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513280 00000100:00100000:3.0:1789760770.328401:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513280 00000100:00100000:3.0:1789760770.328442:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789760770.328451:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+17:5944:x1876700066513280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760770.328464:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760770.328477:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11fef200/0x1287b6a7b7c529a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c5299d expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.328501:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11fef200/0x1287b6a7b7c529a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c5299d expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.328524:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11fef200/0x1287b6a7b7c529a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c5299d expref: 18 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.328533:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11fef200, rc 0) 00000100:00100000:3.0:1789760770.328582:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066513280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.328589:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789760770.329042:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760770.329067:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c529a4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.329078:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c529a4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760770.329145:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03416a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760770.329178:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760770.329198:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760770.329237:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513408 00000100:00100000:3.0:1789760770.329242:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513408 00000100:00100000:2.0:1789760770.329280:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789760770.329292:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066513408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760770.329420:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066513408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760770.329428:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789760770.329447:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03416a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.329479:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.329514:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.329551:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f436000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.329559:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513536 00000100:00100000:0.0:1789760770.329564:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513536 00000100:00100000:0.0:1789760770.329601:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789760770.329607:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c11eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066513536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760770.329687:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c11eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066513536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.329694:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789760770.329758:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.330384:0:8890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8890:1876700066513664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760770.331563:0:8890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.331599:0:8890:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f4366c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.335723:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513664 00000100:00100000:0.0:1789760770.335738:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513664 00000100:00100000:0.0:1789760770.335819:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789760770.335830:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:8890:x1876700066513664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760770.336020:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+18:8890:x1876700066513664:12345-0@lo:502:llog_process_th.0 Request processed in 192us (4460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.336029:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789760770.340136:0:8890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8890:1876700066513664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760770.340186:0:8890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760770.340197:0:8890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760770.340199:0:8890:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789760770.340206:0:8890:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09c05703000 00000020:00000080:1.0:1789760770.340209:0:8890:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789760770.340575:0:8890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8890:1876700066513792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760770.340658:0:8890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760770.340700:0:8890:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ec83c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760770.344334:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513792 00000100:00100000:3.0:1789760770.344349:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513792 00000100:00100000:3.0:1789760770.344489:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789760770.344501:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:8890:x1876700066513792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760770.344669:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+18:8890:x1876700066513792:12345-0@lo:502:llog_process_th.0 Request processed in 170us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.344677:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789760770.344799:0:8890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8890:1876700066513792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760770.344835:0:8890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760770.344843:0:8890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760770.344846:0:8890:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789760770.344850:0:8890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789760770.347494:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789760770.347530:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789760770.347543:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c529a4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.347555:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c11fef800/0x1287b6a7b7c5299d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c529a4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760770.347566:0:5944:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789760770.347569:0:5944:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09c1126a000 from 4 10000000:01000000:3.0:1789760770.347571:0:5944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760770.347605:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.347613:0:5944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.347623:0:5944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.347645:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.347704:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.347802:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3f436840 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.353190:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066513920 00000100:00100000:0.0:1789760770.353203:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066513920 00000100:00100000:0.0:1789760770.353313:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789760770.353325:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+18:5944:x1876700066513920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760770.353357:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760770.353374:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35324400/0x1287b6a7b7c529b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1287b6a7b7c529ab expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.353403:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35324400/0x1287b6a7b7c529b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1287b6a7b7c529ab expref: 19 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.353486:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35324400/0x1287b6a7b7c529b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1287b6a7b7c529ab expref: 19 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.353496:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35324400, rc 0) 00000100:00100000:0.0:1789760770.353579:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066513920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (5874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.353586:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789760770.357134:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066513920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760770.357161:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c529b2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.357186:0:5944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1287b6a7b7c529b2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.357261:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066514048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760770.357312:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760770.359571:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ae3d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760770.360595:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514048 00000100:00100000:3.0:1789760770.360605:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514048 00000100:00100000:3.0:1789760770.360657:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789760770.360666:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066514048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760770.361635:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066514048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 966us (4318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760770.361647:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789760770.362978:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066514048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760770.363036:0:5944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066514176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760770.363095:0:5944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760770.363126:0:5944:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3ae3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.363191:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514176 00000100:00100000:0.0:1789760770.363197:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514176 00000100:00100000:0.0:1789760770.363244:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789760770.363254:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066514176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760770.363368:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:5944:x1876700066514176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.363375:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789760770.363437:0:5944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:586668c1-4957-4570-b773-2405a941ae03:5944:1876700066514176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760770.363663:0:8893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8893:1876700066514304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760770.363697:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760770.363719:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514304 00000100:00100000:0.0:1789760770.363723:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514304 00000100:00100000:0.0:1789760770.363747:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789760770.363794:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:8893:x1876700066514304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760770.363868:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:8893:x1876700066514304:12345-0@lo:502:llog_process_th.0 Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.363875:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789760770.363906:0:8893:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.363919:0:8893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8893:1876700066514304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789760770.363941:0:8893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760770.363962:0:8893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760770.363965:0:8893:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789760770.363973:0:8893:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09c1126a000 00000020:00000080:0.0:1789760770.363975:0:8893:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789760770.364052:0:8893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8893:1876700066514432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760770.364082:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760770.364101:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514432 00000100:00100000:0.0:1789760770.364105:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514432 00000100:00100000:0.0:1789760770.364125:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760770.364131:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:8893:x1876700066514432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760770.364189:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:8893:x1876700066514432:12345-0@lo:502:llog_process_th.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.364196:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760770.364222:0:8893:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09c3bb6b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760770.364233:0:8893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c03414380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:586668c1-4957-4570-b773-2405a941ae03:8893:1876700066514432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789760770.364248:0:8893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760770.364253:0:8893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760770.364254:0:8893:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789760770.364257:0:8893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789760770.364314:0:5944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789760770.364339:0:5944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760770.364350:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c529b2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.364360:0:5944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffffa09c11feee00/0x1287b6a7b7c529ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1287b6a7b7c529b2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.336898:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760771.722510:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066514560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.722604:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.722659:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1876700066515072:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.722853:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.722884:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760771.722890:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066514944:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.722924:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.722971:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066514688:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.722995:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.723011:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066515200:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.723034:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.724927:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789760771.724959:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066514816:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.725036:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.725058:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066515328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760771.725085:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760771.725133:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514560 00000100:00100000:3.0:1789760771.725144:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514560 00000100:00100000:3.0:1789760771.725218:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789760771.725228:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3442:x1876700066514560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.725636:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3442:x1876700066514560:12345-0@lo:400:kworker.0 Request processed in 408us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760771.725645:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789760771.725689:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515072 00000100:00100000:3.0:1789760771.725694:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515072 00000100:00100000:3.0:1789760771.725731:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514688 00000100:00100000:3.0:1789760771.725741:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514688 00000100:00100000:3.0:1789760771.725757:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514816 00000100:00100000:3.0:1789760771.725791:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514816 00000100:00100000:3.0:1789760771.725817:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760771.725824:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1876700066515072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760771.725970:0:5947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789760771.725981:0:5947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1789760771.726001:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760771.726167:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760771.726175:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066514688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760771.726224:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066514688:12345-0@lo:400:kworker.0 Request processed in 50us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760771.726230:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760771.726277:0:5948:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789760771.726289:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789760771.726297:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760771.726338:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066514816:12345-0@lo:400:kworker.0 Request processed in 43us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760771.726345:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760771.726482:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066514816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760771.726502:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066514688:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.727332:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1876700066515072:12345-0@lo:400:kworker.0 Request processed in 1502us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760771.727344:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760771.727379:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515328 00000100:00100000:3.0:1789760771.727386:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515328 00000100:00100000:3.0:1789760771.727512:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760771.727523:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066515328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760771.727555:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760771.727602:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066515328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760771.727609:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760771.727648:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066514560:0@lo:400:kworker.0 00000100:00100000:3.0:1789760771.727664:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1876700066515072:0@lo:400:kworker.0 00000100:00080000:1.0:1789760771.727778:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789760771.727820:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede2300 x1876700066515328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760771.727860:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066515328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760771.728586:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066514944 00000100:00100000:0.0:1789760771.728594:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066514944 00000100:00100000:0.0:1789760771.728649:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515200 00000100:00100000:0.0:1789760771.728653:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515200 00000100:00100000:0.0:1789760771.728679:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760771.728689:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066514944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760771.728756:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066514944:12345-0@lo:400:kworker.0 Request processed in 69us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760771.728779:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760771.728794:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760771.728801:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066515200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760771.728878:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066515200:12345-0@lo:400:kworker.0 Request processed in 78us (5843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760771.728885:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789760771.728921:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760771.728956:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f229c00 x1876700066514944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760771.728969:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066514944:0@lo:400:kworker.0 00010000:00080000:0.0:1789760771.729007:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f228380 x1876700066515200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760771.729030:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066515200:0@lo:400:kworker.0 00010000:00010000:0.0:1789760772.361084:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760772.745064:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760772.745098:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066515456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760772.745199:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760772.745426:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515456 00000100:00100000:3.0:1789760772.745437:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515456 00000100:00100000:3.0:1789760772.745512:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760772.745524:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066515456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760772.745563:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760772.745623:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3eced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066515456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760772.745631:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789760772.745699:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede2300 x1876700066515456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760772.745722:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066515456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760773.387917:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760774.409955:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760775.103737:0:9174:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789760775.183939:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760775.184035:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048660992 00000100:00100000:0.0:1789760775.184047:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048660992 00000100:00100000:0.0:1789760775.184104:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:0.0:1789760775.184114:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2362:x1876700048660992:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760775.184190:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2362:x1876700048660992:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760775.184197:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:1.0:1789760775.191123:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760775.191200:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661120 00000100:00100000:3.0:1789760775.191209:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661120 00000100:00080000:0.0:1789760775.191306:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760775.191517:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1789760775.191529:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2362:x1876700048661120:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760775.191621:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2362:x1876700048661120:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 95us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760775.191629:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1789760775.193185:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760775.193258:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760775.196051:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661248 00000100:00100000:0.0:1789760775.196064:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661248 00000100:00100000:0.0:1789760775.196126:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661376 00000100:00100000:0.0:1789760775.196129:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661376 00000100:00100000:0.0:1789760775.196151:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1789760775.196160:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2362:x1876700048661248:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760775.196227:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2362:x1876700048661248:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760775.196235:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1789760775.196250:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1789760775.196255:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2362:x1876700048661376:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760775.196274:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2362:x1876700048661376:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 19us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760775.196280:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00080000:2.0:1789760775.196646:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760775.196650:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760775.433222:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760776.456979:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760776.842946:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066515968:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843016:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760776.843080:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789760776.843098:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066515584:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843133:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760776.843170:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066516096:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843198:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760776.843231:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066515712:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843261:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760776.843285:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066516224:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843309:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760776.843336:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760776.843342:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ececa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066515840:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843367:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760776.843403:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515968 00000100:00100000:2.0:1789760776.843409:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515968 00000100:00100000:2.0:1789760776.843456:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516224 00000100:00100000:2.0:1789760776.843459:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516224 00000100:00100000:2.0:1789760776.843482:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760776.843492:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3eced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843558:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3eced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066515968:12345-0@lo:400:kworker.0 Request processed in 67us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760776.843567:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760776.843589:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760776.843597:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066516224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843635:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066516224:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760776.843643:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760776.843677:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515584 00000100:00100000:2.0:1789760776.843687:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515584 00000100:00100000:2.0:1789760776.843715:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760776.843722:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066515584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843754:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066515584:12345-0@lo:400:kworker.0 Request processed in 33us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760776.843794:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760776.843825:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516096 00000100:00100000:2.0:1789760776.843829:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516096 00000100:00100000:2.0:1789760776.843855:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515712 00000100:00100000:2.0:1789760776.843858:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515712 00000100:00100000:2.0:1789760776.843870:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066515840 00000100:00100000:2.0:1789760776.843872:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066515840 00000100:00100000:2.0:1789760776.843890:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760776.843897:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066516096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843941:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066516096:12345-0@lo:400:kworker.0 Request processed in 45us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760776.843947:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760776.843959:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789760776.843964:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066515712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.843988:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066515712:12345-0@lo:400:kworker.0 Request processed in 24us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760776.843994:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789760776.844003:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760776.844009:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066515840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.844031:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066515840:12345-0@lo:400:kworker.0 Request processed in 23us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760776.844037:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789760776.844065:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760776.844070:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760776.844072:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760776.844110:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ececa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066515840:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.844121:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066515712:0@lo:400:kworker.0 00010000:00080000:2.0:1789760776.844131:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ecefb80 x1876700066516224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760776.844142:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066516224:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.844174:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066515584:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.844185:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066516096:0@lo:400:kworker.0 00010000:00080000:2.0:1789760776.844196:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ecee680 x1876700066515968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760776.844207:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066515968:0@lo:400:kworker.0 00000100:00100000:2.0:1789760776.844231:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066516352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760776.844259:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760776.844332:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516352 00000100:00100000:1.0:1789760776.844338:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516352 00000100:00100000:1.0:1789760776.844371:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760776.844379:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066516352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760776.844400:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760776.844440:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066516352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760776.844447:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789760776.844624:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede3480 x1876700066516352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760776.844639:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066516352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760777.480980:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760777.864950:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760777.864970:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066516480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760777.865033:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760777.865101:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516480 00000100:00100000:3.0:1789760777.865109:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516480 00000100:00100000:3.0:1789760777.865153:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760777.865162:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066516480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760777.865190:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760777.865231:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066516480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760777.865238:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789760777.865277:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f22a680 x1876700066516480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760777.865294:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066516480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760778.504915:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789760778.642048:0:9417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00010000:00010000:0.0:1789760779.528981:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760780.309106:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760780.309261:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760780.310085:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661632 00000100:00100000:2.0:1789760780.310097:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661632 00000100:00100000:2.0:1789760780.310187:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1789760780.310199:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048661632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1789760780.310286:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048661632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760780.310294:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00080000:0.0:1789760780.310632:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760780.311622:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661504 00000100:00100000:3.0:1789760780.311630:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661504 00000100:00100000:3.0:1789760780.311677:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:3.0:1789760780.311686:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2359:x1876700048661504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760780.311747:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2359:x1876700048661504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 62us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760780.311757:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1789760780.311823:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760780.311975:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661888 00000100:00100000:3.0:1789760780.311979:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661888 00000100:00100000:3.0:1789760780.312019:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1789760780.312025:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2360:x1876700048661888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760780.312097:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2360:x1876700048661888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760780.312105:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00080000:0.0:1789760780.312162:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760780.312446:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760780.312517:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048661760 00000100:00100000:2.0:1789760780.312521:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048661760 00000100:00100000:2.0:1789760780.312572:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1789760780.312581:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c03416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2360:x1876700048661760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1789760780.312620:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c03416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2360:x1876700048661760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760780.312626:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00080000:0.0:1789760780.312722:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760780.553082:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760781.576958:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760781.973575:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760781.973596:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066516608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760781.973656:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.974268:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066516736:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974304:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.974326:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066517248:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974347:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.974370:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760781.974375:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066516864:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974405:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.974613:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517248 00000100:00100000:1.0:1789760781.974620:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517248 00000100:00100000:1.0:1789760781.974704:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516864 00000100:00100000:1.0:1789760781.974708:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516864 00000100:00100000:1.0:1789760781.974726:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760781.974734:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066517248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974798:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066517248:12345-0@lo:400:kworker.0 Request processed in 65us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760781.974806:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760781.974821:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760781.974826:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066516864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974852:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066516864:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760781.974858:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760781.974895:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066516992:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974919:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.974937:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760781.974942:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ede1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066517120:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.974965:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760781.975007:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066516864:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.975017:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066517248:0@lo:400:kworker.0 00000100:00100000:1.0:1789760781.975039:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516992 00000100:00100000:1.0:1789760781.975042:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516992 00000100:00100000:2.0:1789760781.975114:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516736 00000100:00100000:2.0:1789760781.975119:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516736 00000100:00100000:2.0:1789760781.975152:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789760781.975160:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066516736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.975196:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066516736:12345-0@lo:400:kworker.0 Request processed in 38us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760781.975203:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789760781.975240:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066516736:0@lo:400:kworker.0 00000100:00100000:2.0:1789760781.976226:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066516608 00000100:00100000:2.0:1789760781.976235:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066516608 00000100:00100000:3.0:1789760781.976343:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517120 00000100:00100000:3.0:1789760781.976348:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517120 00000100:00080000:0.0:1789760781.976585:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760781.976589:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760781.976592:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760781.976653:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760781.976661:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ede0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066516608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760781.976665:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760781.976673:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066516992:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789760781.976686:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760781.976728:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066516992:12345-0@lo:400:kworker.0 Request processed in 55us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760781.976728:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ede0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066516608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760781.976735:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789760781.976744:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760781.976797:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066516992:0@lo:400:kworker.0 00010000:00080000:2.0:1789760781.976813:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede1180 x1876700066516608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760781.976827:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066516608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760781.977654:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760781.977664:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066517120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760781.977723:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066517120:12345-0@lo:400:kworker.0 Request processed in 61us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760781.977730:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789760781.977813:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3ede1500 x1876700066517120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760781.977825:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ede1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066517120:0@lo:400:kworker.0 00000001:02000400:3.0:1789760782.209837:0:9601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:2.0:1789760782.604043:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760782.985622:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066517376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760782.985686:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760782.985815:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517376 00000100:00100000:0.0:1789760782.985823:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517376 00000100:00100000:0.0:1789760782.985881:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760782.985891:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066517376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760782.985919:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789760782.985972:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066517376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760782.985979:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789760782.986011:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c17d36300 x1876700066517376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760782.986029:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066517376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760783.626027:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760784.017454:0:9698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:0.0:1789760784.649003:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760785.431348:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760785.431396:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760785.431604:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662144 00000100:00100000:0.0:1789760785.431614:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662144 00000100:00100000:0.0:1789760785.431699:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1789760785.431711:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2362:x1876700048662144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760785.431798:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2362:x1876700048662144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 90us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760785.431805:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1789760785.432268:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662016 00000100:00100000:2.0:1789760785.432273:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662016 00000100:00100000:2.0:1789760785.432313:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1789760785.432321:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2362:x1876700048662016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1789760785.432363:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2362:x1876700048662016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760785.432370:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00080000:1.0:1789760785.432503:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760785.439481:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760785.439526:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760785.439656:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662272 00000100:00100000:2.0:1789760785.439667:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662272 00000100:00100000:3.0:1789760785.439681:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662400 00000100:00100000:3.0:1789760785.439688:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662400 00000100:00080000:1.0:1789760785.439754:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760785.439758:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760785.440156:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1789760785.440168:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2358:x1876700048662272:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:0.0:1789760785.440206:0:6931:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1287b6a7b7c528ee 00000100:00080000:0.0:1789760785.440216:0:6931:0:(import.c:65:import_set_state_nolock()) ffffa09c3ecca000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789760785.440253:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000001:00000004:0.0:1789760785.440261:0:6931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789760785.440267:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+5:2358:x1876700048662400:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:3.0:1789760785.440302:0:6933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1287b6a7b7c528f5 00000100:00080000:3.0:1789760785.440310:0:6933:0:(import.c:65:import_set_state_nolock()) ffffa09c3eccf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789760785.440358:0:6933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789760785.440410:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+2:2358:x1876700048662272:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 244us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760785.440419:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1789760785.440481:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+2:2358:x1876700048662400:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 217us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760785.440489:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00010000:00010000:3.0:1789760785.440511:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760785.440746:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760785.672901:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760785.840462:0:9796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:3.0:1789760786.698297:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760787.083438:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f55e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066517504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760787.083506:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760787.083599:0:6935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517504 00000100:00100000:1.0:1789760787.084037:0:6935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517504 00000100:00100000:1.0:1789760787.084098:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760787.084110:0:6935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066517504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760787.084142:0:6935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789760787.084148:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066517760:0@lo:400:kworker.0 00000100:00100000:2.0:1789760787.084193:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760787.084233:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760787.084239:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066517888:0@lo:400:kworker.0 00000100:00100000:2.0:1789760787.084272:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760787.084466:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517760 00000100:00100000:2.0:1789760787.084471:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517760 00000100:00100000:2.0:1789760787.084502:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517888 00000100:00100000:2.0:1789760787.084505:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517888 00000100:00100000:2.0:1789760787.084529:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789760787.084536:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3eceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066517760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760787.084581:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3eceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1876700066517760:12345-0@lo:400:kworker.0 Request processed in 45us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760787.084589:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789760787.084607:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789760787.084613:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066517888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760787.084640:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066517888:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760787.084645:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789760787.084687:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066517888:0@lo:400:kworker.0 00000100:00100000:2.0:1789760787.084697:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1876700066517760:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.085931:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ecedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066517632:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.085983:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760787.086021:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3ececa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1876700066518144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086050:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760787.086074:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760787.086081:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3eceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066518016:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086107:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789760787.086139:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760787.086145:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760787.086155:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066517632 00000100:00100000:0.0:1789760787.086160:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066517632 00000100:00100000:0.0:1789760787.086197:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760787.086212:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3442:x1876700066517632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086255:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3442:x1876700066517632:12345-0@lo:400:kworker.0 Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.086262:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760787.086293:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518144 00000100:00100000:0.0:1789760787.086297:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518144 00000100:00100000:0.0:1789760787.086325:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760787.086331:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1876700066518144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086359:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1876700066518144:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.086365:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760787.086383:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518016 00000100:00100000:0.0:1789760787.086386:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518016 00000100:00100000:0.0:1789760787.086415:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760787.086422:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066518016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086452:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066518016:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.086459:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789760787.086482:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760787.086485:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760787.086506:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3eceed80 x1876700066518016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760787.086519:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3eceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066518016:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086528:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ecedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066517632:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.086536:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3ececa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1876700066518144:0@lo:400:kworker.0 00010000:00080000:0.0:1789760787.086600:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f55e300 x1876700066517504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760787.087910:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f55e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066517504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760787.088342:0:6935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066517504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4233us (4833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760787.088353:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000001:02000400:0.0:1789760787.264496:0:9844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanityn ============----- Fri Sep 18 15:46:25 EDT 2026 00010000:00010000:2.0:1789760787.721029:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760788.105957:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066518272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760788.106025:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.106113:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518272 00000100:00100000:1.0:1789760788.106121:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518272 00000100:00100000:1.0:1789760788.106167:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760788.106183:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066518272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760788.106211:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760788.112345:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066518272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6153us (6309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.112359:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789760788.112475:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f22a680 x1876700066518272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760788.112506:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066518272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760788.745235:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760789.773109:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760790.550294:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760790.550362:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760790.550510:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662528 00000100:00100000:3.0:1789760790.550524:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662528 00000100:00100000:2.0:1789760790.550650:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662656 00000100:00100000:2.0:1789760790.550670:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662656 00000100:00100000:2.0:1789760790.550749:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1789760790.550813:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c17d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2361:x1876700048662656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1789760790.550917:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c17d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2361:x1876700048662656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 157us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760790.550926:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00080000:1.0:1789760790.551229:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760790.552882:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1789760790.552905:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048662528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760790.553013:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048662528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 115us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760790.553023:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000001:00100000:2.0:1789760790.670453:0:8002:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00000020:00000080:2.0:1789760790.670465:0:8002:0:(genops.c:885:class_export_put()) final put ffffa09c3ecc8800/c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00000020:00000080:0.0:1789760790.670668:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa09c3ecc8800/c2c87d9a-ec5f-46cf-8e98-545b26703d9f for lustre-OST0001 00000020:00000080:0.0:1789760790.678484:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09c3eccf000 for lustre-OST0001 00010000:00010000:2.0:1789760790.793484:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789760791.177980:0:6926:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00000020:00000080:0.0:1789760791.177989:0:6926:0:(genops.c:885:class_export_put()) final put ffffa09c3eccc000/c2c87d9a-ec5f-46cf-8e98-545b26703d9f 00000020:00000080:3.0:1789760791.183864:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa09c3eccc000/c2c87d9a-ec5f-46cf-8e98-545b26703d9f for lustre-OST0000 00000020:00000080:3.0:1789760791.183995:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09c3ecca000 for lustre-OST0000 00010000:00010000:3.0:1789760791.817346:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760792.200997:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066518400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760792.201113:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760792.201229:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518400 00000100:00100000:0.0:1789760792.201238:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518400 00000100:00100000:2.0:1789760792.201245:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066518912:0@lo:400:kworker.0 00000100:00100000:2.0:1789760792.201273:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.201330:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c17d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066518528:0@lo:400:kworker.0 00000100:00100000:0.0:1789760792.202643:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789760792.202658:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066518400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760792.202690:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760792.202759:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1876700066518656:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.202903:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.202943:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066519040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.202968:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789760792.203065:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760792.203080:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518528 00000100:00100000:1.0:1789760792.203086:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518528 00000100:00100000:1.0:1789760792.203125:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789760792.203131:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c2a7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.203181:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c2a7c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066518528:12345-0@lo:400:kworker.0 Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.203189:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789760792.203230:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c17d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066518528:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.203273:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519040 00000100:00100000:1.0:1789760792.203276:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519040 00000100:00100000:1.0:1789760792.203306:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789760792.203312:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.203346:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066519040:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.203351:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789760792.203379:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760792.203409:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066519040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.203461:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518912 00000100:00100000:1.0:1789760792.203464:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518912 00000100:00100000:1.0:1789760792.203491:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760792.203496:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3eced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.203525:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3eced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066518912:12345-0@lo:400:kworker.0 Request processed in 29us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.203530:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789760792.203540:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789760792.204566:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f219c00 x1876700066518912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760792.204573:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760792.204582:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066518400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1924us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.204588:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066518912:0@lo:400:kworker.0 00000100:00100000:0.0:1789760792.204597:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789760792.204626:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f55c700 x1876700066518400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760792.204645:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066518400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760792.204663:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066519168:0@lo:400:kworker.0 00000100:00100000:2.0:1789760792.204667:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760792.204677:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1876700066518784:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.204691:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518656 00000100:00100000:1.0:1789760792.204697:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518656 00000100:00100000:3.0:1789760792.204702:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.204735:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789760792.204744:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1876700066518656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760792.204782:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.204837:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1876700066518656:12345-0@lo:400:kworker.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.204845:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760792.204851:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066518784 00000100:00100000:2.0:1789760792.204856:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066518784 00000100:00080000:1.0:1789760792.204875:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760792.204894:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760792.204913:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1876700066518784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760792.204957:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1876700066518784:12345-0@lo:400:kworker.0 Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760792.204964:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789760792.205016:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1876700066518784:0@lo:400:kworker.0 00000100:00100000:0.0:1789760792.205421:0:6931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519168 00000100:00100000:0.0:1789760792.205468:0:6931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519168 00000100:00100000:3.0:1789760792.205534:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1876700066518656:0@lo:400:kworker.0 00000100:00100000:0.0:1789760792.205587:0:6931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760792.205597:0:6931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066519168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760792.205646:0:6931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066519168:12345-0@lo:400:kworker.0 Request processed in 51us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.205652:0:6931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789760792.205683:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f21b800 x1876700066519168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760792.205702:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066519168:0@lo:400:kworker.0 00010000:00010000:2.0:1789760792.842609:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760793.225423:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066519296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760793.225489:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760793.225923:0:6935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519296 00000100:00100000:2.0:1789760793.225931:0:6935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519296 00000100:00100000:2.0:1789760793.226006:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789760793.226018:0:6935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066519296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760793.226044:0:6935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1789760793.227708:0:6935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066519296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1686us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.227721:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789760793.228098:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f229c00 x1876700066519296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760793.228120:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066519296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789760793.865064:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760794.889068:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760795.666360:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760795.666475:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662784 00000100:00100000:3.0:1789760795.666485:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662784 00000100:00100000:3.0:1789760795.666532:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1789760795.666541:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2359:x1876700048662784:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760795.667050:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2359:x1876700048662784:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 508us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.667059:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:0.0:1789760795.667735:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760795.667904:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048662912 00000100:00100000:3.0:1789760795.667911:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048662912 00000100:00100000:3.0:1789760795.667993:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1789760795.668002:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048662912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760795.668052:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048662912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 51us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.668058:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00080000:0.0:1789760795.670036:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760795.915908:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760796.937095:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760797.322416:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1876700066519552:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.322483:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.322538:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066520064:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.322562:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.322592:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789760797.322599:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066519680:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.322608:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520064 00000100:00100000:1.0:1789760797.322617:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520064 00000100:00100000:0.0:1789760797.322647:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.322673:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066520192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760797.322679:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760797.322692:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066520064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.322704:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.322736:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519552 00000100:00100000:0.0:1789760797.322741:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519552 00000100:00100000:0.0:1789760797.322798:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519680 00000100:00100000:0.0:1789760797.322802:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519680 00000100:00100000:0.0:1789760797.322822:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760797.322829:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1876700066519552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.322860:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1876700066519552:12345-0@lo:400:kworker.0 Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.322867:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760797.322891:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789760797.322897:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066519680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.322926:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1876700066519680:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.322931:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789760797.322946:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760797.322950:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760797.322961:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520192 00000100:00100000:0.0:1789760797.322964:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520192 00000100:00100000:0.0:1789760797.322987:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760797.322993:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1876700066520192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760797.323014:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1789760797.323045:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1876700066520192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.323052:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760797.323096:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1876700066519680:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.323115:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066520064:12345-0@lo:400:kworker.0 Request processed in 425us (550us total) trans 0 rc 0/0 00010000:00080000:0.0:1789760797.323117:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f55f480 x1876700066520192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760797.323137:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066520192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760797.323148:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1876700066519552:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.323153:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789760797.323163:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f218000 x1876700066520064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760797.323173:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066520064:0@lo:400:kworker.0 00000100:00100000:2.0:1789760797.323315:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066519808:0@lo:400:kworker.0 00000100:00100000:2.0:1789760797.323344:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760797.323370:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789760797.323375:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066519424:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.323401:0:6933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519808 00000100:00100000:2.0:1789760797.323404:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760797.323407:0:6933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519808 00000100:00100000:2.0:1789760797.323431:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066519936:0@lo:400:kworker.0 00000100:00100000:2.0:1789760797.323453:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760797.323475:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519936 00000100:00100000:2.0:1789760797.323478:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519936 00000100:00100000:1.0:1789760797.323545:0:6933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789760797.323553:0:6933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066519808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.323607:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066519424 00000100:00100000:0.0:1789760797.323612:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066519424 00000100:00100000:1.0:1789760797.323615:0:6933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1876700066519808:12345-0@lo:400:kworker.0 Request processed in 62us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760797.323625:0:6933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760797.323654:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789760797.323662:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066519424:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789760797.323669:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f21b800 x1876700066519808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760797.323680:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1876700066519808:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.323702:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:586668c1-4957-4570-b773-2405a941ae03:3439:1876700066519424:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.323703:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3439:x1876700066519424:12345-0@lo:400:kworker.0 Request processed in 40us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.323715:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1789760797.324537:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760797.324544:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760797.324567:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760797.324576:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066519936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760797.324627:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ececa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1876700066519936:12345-0@lo:400:kworker.0 Request processed in 53us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760797.324646:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789760797.324671:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1876700066519936:0@lo:400:kworker.0 00010000:00010000:1.0:1789760797.961222:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760798.347535:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760798.347572:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066520320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760798.347671:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760798.347812:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520320 00000100:00100000:3.0:1789760798.347824:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520320 00000100:00100000:3.0:1789760798.347897:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760798.347909:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066520320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760798.347951:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760798.348046:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ecedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066520320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760798.348055:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789760798.348122:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f228e00 x1876700066520320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760798.348143:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066520320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760798.985967:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760800.009941:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760800.238006:0:10571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 40a 00000100:00100000:2.0:1789760800.784921:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760800.784950:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663168 00000100:00100000:0.0:1789760800.784960:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663168 00000100:00100000:2.0:1789760800.784969:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760800.785025:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1789760800.785036:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3eceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2361:x1876700048663168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760800.785116:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3eceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2361:x1876700048663168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760800.785124:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00080000:0.0:1789760800.785148:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760800.785580:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663040 00000100:00100000:3.0:1789760800.785586:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663040 00000100:00100000:3.0:1789760800.785627:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1789760800.785636:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048663040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760800.785890:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:2361:x1876700048663040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 254us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760800.785897:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000001:02000400:3.0:1789760800.957628:0:10619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00010000:00010000:1.0:1789760801.033996:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760801.581701:0:10667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: start setup 15:46:40 (1789760800) === 00000100:00100000:2.0:1789760801.755622:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.755745:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663296 00000100:00100000:1.0:1789760801.755755:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663296 00000100:00100000:1.0:1789760801.755845:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:1.0:1789760801.755857:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+10:8297:x1876700048663296:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789760801.755873:0:5939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760801.755889:0:5939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c013f2a00/0x1287b6a7b7c529b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c5622c expref: -99 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760801.755940:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c013f2a00/0x1287b6a7b7c529b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c5622c expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760801.755951:0:5939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c013f2a00/0x1287b6a7b7c529b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c5622c expref: 11 pid: 5939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760801.755960:0:5939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c013f2a00, rc 0) 00000100:00100000:1.0:1789760801.756016:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8297:x1876700048663296:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 161us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.756023:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:2.0:1789760801.757381:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760801.757515:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663424 00000100:00100000:0.0:1789760801.757521:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663424 00000100:00100000:0.0:1789760801.757557:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:0.0:1789760801.757565:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8297:x1876700048663424:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789760801.757709:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8297:x1876700048663424:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 144us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.757728:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1789760801.759242:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.759285:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663552 00000100:00100000:1.0:1789760801.759289:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663552 00000100:00100000:1.0:1789760801.759363:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:1.0:1789760801.759376:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8297:x1876700048663552:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789760801.759465:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8297:x1876700048663552:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.759470:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:2.0:1789760801.761560:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760801.761630:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663680 00000100:00100000:0.0:1789760801.761637:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663680 00000100:00100000:0.0:1789760801.761691:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1789760801.761701:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8301:x1876700048663680:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760801.761861:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8301:x1876700048663680:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 162us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.761876:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1789760801.768999:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.769144:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663808 00000100:00100000:1.0:1789760801.769168:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663808 00000100:00100000:1.0:1789760801.769245:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:1.0:1789760801.769257:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8301:x1876700048663808:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789760801.769442:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8301:x1876700048663808:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 187us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.769449:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:2.0:1789760801.773326:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760801.773428:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048663936 00000100:00100000:0.0:1789760801.773443:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048663936 00000100:00100000:0.0:1789760801.773511:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:0.0:1789760801.773521:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+11:8297:x1876700048663936:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789760801.773536:0:5941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760801.773552:0:5941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c35325000/0x1287b6a7b7c529c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c56256 expref: -99 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760801.773579:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c35325000/0x1287b6a7b7c529c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56256 expref: 12 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760801.773589:0:5941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c35325000/0x1287b6a7b7c529c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c56256 expref: 12 pid: 5941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760801.773598:0:5941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c35325000, rc 0) 00000100:00100000:0.0:1789760801.773660:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+12:8297:x1876700048663936:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 141us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.773668:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1789760801.778976:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.779069:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664064 00000100:00100000:1.0:1789760801.779090:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664064 00000100:00100000:1.0:1789760801.779193:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1789760801.779203:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+12:8297:x1876700048664064:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789760801.779228:0:5939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789760801.779243:0:5939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789760801.779247:0:5939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789760801.779250:0:5939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789760801.779252:0:5939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789760801.780226:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+12:8297:x1876700048664064:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 1022us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.780236:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:2.0:1789760801.782220:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760801.782293:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664192 00000100:00100000:3.0:1789760801.782303:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664192 00000100:00100000:3.0:1789760801.782361:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1789760801.782373:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+12:8297:x1876700048664192:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789760801.782393:0:5940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760801.782415:0:5940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09c11fee800/0x1287b6a7b7c529c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d1f44aaa2c5625d expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760801.782450:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09c11fee800/0x1287b6a7b7c529c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c5625d expref: 13 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760801.782464:0:5940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09c11fee800/0x1287b6a7b7c529c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x3d1f44aaa2c5625d expref: 13 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760801.782474:0:5940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09c11fee800, rc 0) 00000100:00100000:3.0:1789760801.782551:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8297:x1876700048664192:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 181us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760801.782559:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:2.0:1789760801.783731:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.783826:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664320 00000100:00100000:1.0:1789760801.783839:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664320 00000100:00100000:1.0:1789760801.783906:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:1.0:1789760801.783917:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8297:x1876700048664320:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789760801.784055:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8297:x1876700048664320:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 139us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.784064:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:2.0:1789760801.785076:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760801.785191:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664448 00000100:00100000:3.0:1789760801.785199:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664448 00000100:00100000:3.0:1789760801.785246:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:3.0:1789760801.785256:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8297:x1876700048664448:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789760801.785438:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8297:x1876700048664448:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 183us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760801.785446:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:2.0:1789760801.787175:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760801.787250:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664576 00000100:00100000:0.0:1789760801.787258:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664576 00000100:00100000:0.0:1789760801.787307:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:0.0:1789760801.787326:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8303:x1876700048664576:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760801.787456:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8303:x1876700048664576:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 132us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.787465:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1789760801.788690:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760801.788844:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664704 00000100:00100000:3.0:1789760801.788851:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664704 00000100:00100000:3.0:1789760801.788892:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:3.0:1789760801.788900:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8303:x1876700048664704:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789760801.789038:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:8303:x1876700048664704:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 138us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760801.789046:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:2.0:1789760801.790750:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760801.790823:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760801.790836:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664832 00000100:00100000:0.0:1789760801.790845:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664832 00000100:00100000:0.0:1789760801.790888:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048664960 00000100:00100000:0.0:1789760801.790891:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048664960 00000100:00100000:3.0:1789760801.790905:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1789760801.790915:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1876700048664832:12345-192.168.203.13@tcp:38:mount.lustre.0 00000100:00100000:0.0:1789760801.790926:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1789760801.790933:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048664960:12345-192.168.203.13@tcp:400:kworker.0 00010000:00080000:3.0:1789760801.790949:0:5948:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cfa8bac1-156b-47a9-afab-fe5753451799@192.168.203.13@tcp t0 exp 0000000000000000 cur 255 last 0 00000100:00100000:0.0:1789760801.791001:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048664960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.791014:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000020:00000080:3.0:1789760801.791094:0:5948:0:(genops.c:1385:class_connect()) connect: client cfa8bac1-156b-47a9-afab-fe5753451799, cookie 0x1287b6a7b7c529ce 00000004:00100000:3.0:1789760801.791128:0:5948:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789760801.791300:0:5948:0:(import.c:65:import_set_state_nolock()) ffffa09c3ef97000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760801.791347:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa8bac1-156b-47a9-afab-fe5753451799+6:2358:x1876700048664832:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 432us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760801.791372:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1789760801.792837:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760801.792867:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.792910:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665216 00000100:00100000:1.0:1789760801.792919:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665216 00000100:00100000:0.0:1789760801.792922:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665088 00000100:00100000:0.0:1789760801.792929:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665088 00000100:00100000:0.0:1789760801.792976:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1789760801.792989:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa8bac1-156b-47a9-afab-fe5753451799+7:0:x1876700048665088:12345-192.168.203.13@tcp:41:mount.lustre.0 00000100:00080000:3.0:1789760801.792995:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760801.793001:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1789760801.793013:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa8bac1-156b-47a9-afab-fe5753451799+7:8297:x1876700048665216:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789760801.793026:0:5947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000004:00000024:1.0:1789760801.793034:0:5946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1789760801.793133:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa8bac1-156b-47a9-afab-fe5753451799+7:8297:x1876700048665216:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.793140:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa8bac1-156b-47a9-afab-fe5753451799+7:0:x1876700048665088:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 152us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.793149:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1789760801.793168:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1789760801.794618:0:3434:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760801.794736:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665344 00000100:00100000:0.0:1789760801.794746:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665344 00000100:00100000:0.0:1789760801.794830:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1789760801.794840:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c04891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa8bac1-156b-47a9-afab-fe5753451799+6:8297:x1876700048665344:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789760801.794921:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c04891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa8bac1-156b-47a9-afab-fe5753451799+6:8297:x1876700048665344:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.794929:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1789760801.797270:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760801.797316:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760801.797361:0:3433:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1789760801.797408:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665472 00000100:00100000:3.0:1789760801.797411:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665600 00000100:00100000:3.0:1789760801.797425:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665600 00000100:00100000:1.0:1789760801.797431:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665472 00000100:00100000:3.0:1789760801.797493:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1789760801.797504:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1876700048665600:12345-192.168.203.13@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789760801.797517:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1789760801.797518:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665728 00000100:00100000:0.0:1789760801.797526:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665728 00010000:00080000:3.0:1789760801.797544:0:6974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cfa8bac1-156b-47a9-afab-fe5753451799@192.168.203.13@tcp t0 exp 0000000000000000 cur 255 last 0 00000100:00100000:1.0:1789760801.797545:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1876700048665472:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789760801.797584:0:6932:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cfa8bac1-156b-47a9-afab-fe5753451799@192.168.203.13@tcp t0 exp 0000000000000000 cur 255 last 0 00000100:00100000:0.0:1789760801.797586:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000020:00000080:3.0:1789760801.797590:0:6974:0:(genops.c:1385:class_connect()) connect: client cfa8bac1-156b-47a9-afab-fe5753451799, cookie 0x1287b6a7b7c529d5 00000100:00100000:0.0:1789760801.797603:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa8bac1-156b-47a9-afab-fe5753451799+6:8297:x1876700048665728:12345-192.168.203.13@tcp:33:mount.lustre.0 00002000:00100000:3.0:1789760801.797605:0:6974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cfa8bac1-156b-47a9-afab-fe5753451799/ffffa09c3ef95000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:1.0:1789760801.797619:0:6932:0:(genops.c:1385:class_connect()) connect: client cfa8bac1-156b-47a9-afab-fe5753451799, cookie 0x1287b6a7b7c529dc 00002000:00100000:3.0:1789760801.797628:0:6974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1789760801.797632:0:6932:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cfa8bac1-156b-47a9-afab-fe5753451799/ffffa09c3f3f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760801.797665:0:6932:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:0.0:1789760801.797706:0:5949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00002000:00080000:3.0:1789760801.797729:0:6974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1789760801.797756:0:6932:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789760801.797803:0:6974:0:(import.c:65:import_set_state_nolock()) ffffa09c3ef97800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760801.797857:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa8bac1-156b-47a9-afab-fe5753451799+6:8297:x1876700048665728:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 257us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760801.797868:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1789760801.797877:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa8bac1-156b-47a9-afab-fe5753451799+6:2358:x1876700048665600:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 367us (553us total) trans 0 rc 0/0 00000100:00080000:1.0:1789760801.797878:0:6932:0:(import.c:65:import_set_state_nolock()) ffffa09c3f3ff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760801.797895:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1789760801.797933:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa8bac1-156b-47a9-afab-fe5753451799+6:2358:x1876700048665472:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 395us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760801.797943:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00010000:00010000:2.0:1789760802.057233:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760802.442403:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066520448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760802.442446:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066520576:0@lo:400:kworker.0 00000100:00100000:1.0:1789760802.442553:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760802.442624:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066520960:0@lo:400:kworker.0 00000100:00100000:1.0:1789760802.442656:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760802.442675:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760802.442681:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1876700066520832:0@lo:400:kworker.0 00000100:00100000:1.0:1789760802.442729:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760802.442759:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520448 00000100:00100000:1.0:1789760802.442782:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520448 00000100:00100000:1.0:1789760802.442831:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760802.442841:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066520448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760802.442863:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760802.442912:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066520448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760802.442920:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760802.442941:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520960 00000100:00100000:1.0:1789760802.442944:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520960 00000100:00100000:1.0:1789760802.442972:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760802.442979:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066520960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760802.443013:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066520960:12345-0@lo:400:kworker.0 Request processed in 35us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760802.443021:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760802.443058:0:5946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520832 00000100:00100000:1.0:1789760802.443062:0:5946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520832 00000100:00100000:1.0:1789760802.443091:0:5946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789760802.443106:0:5946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1876700066520832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760802.443136:0:5946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1876700066520832:12345-0@lo:400:kworker.0 Request processed in 40us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760802.443143:0:5946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789760802.443159:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760802.443163:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760802.443166:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760802.443197:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1876700066520832:0@lo:400:kworker.0 00010000:00080000:1.0:1789760802.443220:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f4fb100 x1876700066520960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760802.443231:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066520960:0@lo:400:kworker.0 00010000:00080000:1.0:1789760802.443241:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f55f100 x1876700066520448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760802.443267:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066520448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760802.443997:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760802.444029:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066521088:0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444053:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760802.444069:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760802.444073:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1876700066520704:0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444089:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760802.444101:0:3441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066521216:0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444129:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760802.444161:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521088 00000100:00100000:3.0:1789760802.444164:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521088 00000100:00100000:1.0:1789760802.444171:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520576 00000100:00100000:1.0:1789760802.444177:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520576 00000100:00100000:3.0:1789760802.444198:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066520704 00000100:00100000:3.0:1789760802.444202:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066520704 00000100:00100000:3.0:1789760802.444224:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789760802.444232:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f4fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066521088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444273:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f4fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1876700066521088:12345-0@lo:400:kworker.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760802.444280:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789760802.444294:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789760802.444301:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1876700066520704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444329:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1876700066520704:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760802.444336:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789760802.444467:0:6932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521216 00000100:00100000:3.0:1789760802.444470:0:6932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521216 00000100:00100000:3.0:1789760802.444517:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760802.444522:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066521216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444547:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1876700066521216:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760802.444551:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760802.444611:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1876700066520704:0@lo:400:kworker.0 00010000:00080000:3.0:1789760802.444618:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f4f8000 x1876700066521216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760802.444625:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1876700066521216:0@lo:400:kworker.0 00000100:00100000:3.0:1789760802.444632:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1876700066521088:0@lo:400:kworker.0 00000100:00080000:3.0:1789760802.444655:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760802.445574:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789760802.445582:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066520576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760802.445625:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:586668c1-4957-4570-b773-2405a941ae03+19:3441:x1876700066520576:12345-0@lo:400:kworker.0 Request processed in 45us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760802.445630:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789760802.445652:0:3441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:586668c1-4957-4570-b773-2405a941ae03:3441:1876700066520576:0@lo:400:kworker.0 00010000:00010000:1.0:1789760803.081497:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760803.464933:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760803.464957:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066521344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760803.465023:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760803.465090:0:6934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521344 00000100:00100000:3.0:1789760803.465100:0:6934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521344 00000100:00100000:3.0:1789760803.465162:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760803.465174:0:6934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066521344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760803.465204:0:6934:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789760803.465260:0:6934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066521344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (238us total) trans 0 rc 0/0 00010000:00080000:1.0:1789760803.465323:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f4f9180 x1876700066521344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760803.465333:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760803.465342:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066521344:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789760803.823789:0:10860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789760804.104855:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760805.128959:0:8819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789760805.819544:0:11121:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789760805.819660:0:11121:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789760806.153972:0:5935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789760806.445392:0:11218:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789760806.445574:0:11218:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789760806.925816:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760806.925845:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760806.925855:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665984 00000100:00100000:3.0:1789760806.925863:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665984 00000100:00100000:2.0:1789760806.925867:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1789760806.925885:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1789760806.925906:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048665856 00000100:00100000:0.0:1789760806.925911:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048665856 00000100:00100000:2.0:1789760806.925914:0:3432:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1789760806.925921:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048666112 00000100:00100000:3.0:1789760806.925925:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048666112 00000100:00100000:1.0:1789760806.925935:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048666240 00000100:00100000:1.0:1789760806.925941:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048666240 00000100:00100000:2.0:1789760806.925945:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1789760806.925952:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1789760806.925957:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048665984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1789760806.925963:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:2360:x1876700048665856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760806.925969:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1789760806.925977:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700048666368 00000100:00100000:3.0:1789760806.925981:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa8bac1-156b-47a9-afab-fe5753451799+6:2360:x1876700048666112:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1789760806.925982:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700048666368 00000100:00100000:1.0:1789760806.926017:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1789760806.926023:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:735c3f4e-8e34-4a4b-ad59-3e0fc7e5f9ea+13:2360:x1876700048665856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760806.926026:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa8bac1-156b-47a9-afab-fe5753451799+6:2360:x1876700048666112:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760806.926027:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2c87d9a-ec5f-46cf-8e98-545b26703d9f+6:2359:x1876700048665984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760806.926033:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1789760806.926035:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa8bac1-156b-47a9-afab-fe5753451799+6:2359:x1876700048666240:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1789760806.926043:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:2.0:1789760806.926051:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00080000:3.0:1789760806.926064:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760806.926068:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760806.926071:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760806.926075:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa8bac1-156b-47a9-afab-fe5753451799+6:2359:x1876700048666240:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 47us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760806.926094:0:6932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1789760806.926104:0:6932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa8bac1-156b-47a9-afab-fe5753451799+6:2360:x1876700048666368:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1789760806.926105:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1789760806.926135:0:6932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa8bac1-156b-47a9-afab-fe5753451799+6:2360:x1876700048666368:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760806.926148:0:6932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000020:00000004:2.0:1789760807.104288:0:11315:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789760807.104432:0:11315:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789760807.177873:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760807.560893:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066521472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760807.560915:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760807.560930:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1876700066521728:0@lo:400:kworker.0 00000100:00100000:2.0:1789760807.560955:0:3439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066521856:0@lo:400:kworker.0 00000100:00100000:1.0:1789760807.560958:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760807.560967:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760807.561007:0:6935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521472 00000100:00100000:0.0:1789760807.561016:0:6935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521472 00000100:00100000:2.0:1789760807.561017:0:3439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760807.561020:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066521600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760807.561023:0:3440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066521984:0@lo:400:kworker.0 00000100:00100000:2.0:1789760807.561064:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521728 00000100:00100000:2.0:1789760807.561071:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521728 00000100:00100000:3.0:1789760807.561074:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760807.561075:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760807.561081:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760807.561094:0:6935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066521472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760807.561114:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521856 00000100:00100000:2.0:1789760807.561119:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521856 00000100:00100000:1.0:1789760807.561123:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521984 00002000:00000024:0.0:1789760807.561124:0:6935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1789760807.561130:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521984 00000100:00100000:3.0:1789760807.561131:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066522240:0@lo:400:kworker.0 00000100:00100000:2.0:1789760807.561147:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760807.561158:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1876700066521728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760807.561163:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760807.561171:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789760807.561182:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760807.561189:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760807.561194:0:6935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066521472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760807.561197:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09c3f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1876700066522112:0@lo:400:kworker.0 00000100:00100000:0.0:1789760807.561208:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789760807.561213:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1876700066521728:12345-0@lo:400:kworker.0 Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760807.561223:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789760807.561228:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760807.561233:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1876700066521984:12345-0@lo:400:kworker.0 Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00080000:0.0:1789760807.561234:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760807.561243:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789760807.561244:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760807.561244:0:8974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066522112 00000100:00080000:0.0:1789760807.561251:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760807.561251:0:8974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066522112 00000100:00100000:1.0:1789760807.561262:0:6974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066522240 00000100:00100000:3.0:1789760807.561266:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1876700066521728:0@lo:400:kworker.0 00000100:00100000:1.0:1789760807.561268:0:6974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066522240 00010000:00080000:0.0:1789760807.561281:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f357b80 x1876700066521984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760807.561290:0:8974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789760807.561291:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066521984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760807.561304:0:6974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789760807.561308:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f55d500 x1876700066521472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760807.561309:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760807.561311:0:8974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066521856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760807.561317:0:6974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066522240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760807.561323:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c3f4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1876700066522112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760807.561342:0:3440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1876700066521472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760807.561373:0:8974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3ed48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1876700066521856:12345-0@lo:400:kworker.0 Request processed in 66us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760807.561381:0:6974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1876700066522240:12345-0@lo:400:kworker.0 Request processed in 67us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760807.561385:0:8974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760807.561385:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c3f4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1876700066522112:12345-0@lo:400:kworker.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760807.561398:0:6974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760807.561398:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760807.561400:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1876700066522112:0@lo:400:kworker.0 00010000:00080000:0.0:1789760807.561415:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09c3f355c00 x1876700066522240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760807.561421:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1876700066522240:0@lo:400:kworker.0 00000100:00080000:2.0:1789760807.561423:0:5942:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760807.561434:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700066521600 00000100:00100000:3.0:1789760807.561438:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700066521600 00000100:00100000:2.0:1789760807.561455:0:3439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1876700066521856:0@lo:400:kworker.0 00000100:00100000:3.0:1789760807.561460:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789760807.561467:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09c382a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:3442:x1876700066521600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760807.561495:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09c382a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:586668c1-4957-4570-b773-2405a941ae03+19:3442:x1876700066521600:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760807.561499:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789760807.561529:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09c3f354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:586668c1-4957-4570-b773-2405a941ae03:3442:1876700066521600:0@lo:400:kworker.0 00000020:00000004:3.0:1789760807.701004:0:11412:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789760807.701150:0:11412:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 Debug log: 7084 lines, 7084 kept, 0 dropped, 0 bad.